Senior Data Engineer · ·

About Us: At 8020REI, you’ll play a key role in shaping the future of data analytics for the real estate investment industry. You’ll have the opportunity to lead data initiatives, work with cutting‑edge technologies, and collaborate with a dynamic team passionate about innovation and results. Core Values at 8020REI: Lead with Innovation: We constantly seek innovative solutions to improve our services and operations. We’ve Got Your Back: Our dedication to surpassing expectations ensures we deliver outstanding support and forge lasting partnerships. Our Word is Our Bond: We maintain a foundation of integrity, fulfilling promises and upholding transparency. We are Limitless: Our culture encourages continuous personal and professional growth, empowering each team member to excel. Bring Your A-Game: We believe in prioritizing wellness and family, enabling our team to perform at their best for our clients and each other. Role Overview. We seek a highly skilled and motivated Senior Data Engineer to spearhead our critical data infrastructure’s design, development, and optimization. You will play a pivotal role in shaping our data landscape, ensuring its scalability, reliability, and performance to power advanced analytics, machine learning models, and innovative AI‑driven solutions. This hands‑on role allows us to shape our entire data landscape using Big Data technologies, PySpark, and AWS. You’ll drive complex ETL processes, build robust data pipelines, and lead strategic initiatives, including API development and cloud migration. If you’re passionate about solving complex data challenges and thrive in a dynamic environment, this role is designed for you. Key Responsibilities: Big Data Pipeline & ETL Architecture: Lead the design, development, and optimization of high‑performance Big Data ETL/ELT pipelines using advanced PySpark techniques. Own our data lake strategy from ingestion through processing large‑scale, diverse datasets to robust storage solutions. Database & Data Lake Lifecycle Management: Take ownership of the end‑to‑end lifecycle for all core data storage systems, including the data lake and relational/NoSQL databases. This includes leading the technical design and implementation of new platforms, executing complex data migrations, and continuously optimizing for performance, scalability, and reliability. AWS Cloud Infrastructure Management: Manage and optimize our comprehensive AWS Big Data ecosystem (EMR, Glue, Lambda, S3, Athena). Drive performance improvements and cost optimization while implementing security best practices (IAM, VPC). Lead strategic cloud migration initiatives for core database systems. Data Quality, Governance & BI Support: Ensure data integrity through comprehensive testing, validation, and governance frameworks. Proactively monitor data pipelines, resolve issues efficiently, and support business intelligence initiatives with analytics‑ready data for tools like Power BI. Strategic Projects & Innovation: Drive high‑impact projects, including public API development and AI/ML data foundations—champion innovation by exploring and implementing emerging technologies that enhance our data capabilities and support new business opportunities. Cross‑Functional Collaboration & Problem Solving: Partner with Data Science, Analytics, and Engineering teams to translate business requirements into effective technical solutions. Provide clear documentation and take ownership of complex data challenges with a solutions‑first mindset. Cloud Cost Administration & Governance: Take full ownership of the cloud data platform's budget, with the primary responsibility of proactively monitoring, managing, and reducing all related costs (e.g., compute, storage, data transfer) to ensure maximum financial efficiency. Qualification: Experience 4+ years of hands‑on Data Engineering experience with large‑scale Big Data systems and a proven track record of delivering impactful solutions. Education Bachelor’s degree in Computer Science, Systems Engineering, Data Engineering, or related technical field. Core Technical Skills: PySpark : Advanced proficiency including optimization techniques, performance tuning, and distributed processing expertise Python : Strong programming capabilities with clean, efficient code practices AWS Ecosystem : Deep experience with EMR, Glue, Lambda, S3, Athena, Step Functions, IAM, API Gateway, EC2, and AWS networking (VPC, subnets, security groups) SQL : Advanced skills in complex queries and data manipulation Big Data Fundamentals : Solid understanding of distributed computing, analytical data modeling, and data warehousing Data Engineering Principles : Strong grasp of pipeline design, data modeling, and lifecycle management with the ability to articulate technical decisions Database & Data Lake Technologies: Expert‑level SQL skills with demonstrated mastery in complex query optimization, performance tuning, and robust data modeling. This must be combined with proven, hands‑on experience implementing solutions using at least one modern data lakehouse framework (Apache Hudi, Apache Iceberg, or Delta Lake). Language Requirements Advanced English and Spanish proficiency (B2 or higher) required. Nice to Have: BI tools expertise (Power BI, Tableau, QuickSight) NoSQL database experience (MongoDB) Infrastructure as Code (AWS CloudFormation) Agile/SCRUM methodology experience Demonstrated commitment to continuous learning and emerging technologies Why Join Us? At 8020REI, you’ll play a key role in shaping the future of data analytics for the real estate investment industry. As a Senior Data Scientist, you’ll have the opportunity to lead data initiatives, work with cutting‑edge technologies, and collaborate with a dynamic team passionate about innovation and results. What We Offer: Competitive Base Compensation Profit Share Bonus Flex PTO (up to 26 days per year) Home Office Upgrade Bonus HMO Bonus Full‑time Remote Work Opportunity for growth and team‑building potential Ongoing support and budget to develop new skills Join us at 8020REI and contribute directly to revolutionizing the real estate investment landscape #J-18808-Ljbffr