Senior Data Engineer, Databricks
Guarda esta oferta y sigue tu búsqueda
Crea una cuenta gratis para guardar empleos, crear alertas y volver a esta oferta desde tu panel.
Al continuar, aceptas nuestros Términos & Política de Privacidad.
Job Description
Insight Global is looking for a senior data engineer to design, build, and maintain production-grade batch and streaming pipelines using Databricks, Lakeflow Declarative Pipelines, and dbt for our client. This person will participate in sprint planning, standups, retrospectives, and backlog grooming. You will monitor and troubleshoot pipeline reliability, performance, and cost, implement centralized data governance and access controls with Unity Catalog and tools such as Immuta, and build DataOps standards, CI/CD automation, and automated data-quality controls. You will be responsible for partnering with cross-functional stakeholders to deliver curated, analytics-ready datasets and data models, and review pipeline designs and code while guiding mid-level and junior engineers. Lastly, you will evaluate emerging Databricks capabilities, including Lakeflow, AI/BI, and SQL AI Functions and recommend improvements to platform architecture and engineering practices. This is a 3 month contract with yearly anticipated extensions remote in Brazil or Colombia.
Skills and Requirements
7+ years of data engineering and architecture experienceDeep, hands-on production experience with Databricks and modern lakehouse platformsStrong Apache Spark experience, including PySpark and Spark SQLExperience building and operating scalable batch and streaming pipelinesExperience with declarative pipeline frameworks, including Lakeflow Declarative PipelinesStrong experience with dbt, Databricks Workflows, and Apache Airflow for data transformation and orchestrationAdvanced SQL and strong Python programming skillsSolid understanding of lakehouse architecture, medallion/layered data modeling, and data warehousingProduction experience with Databricks Unity CatalogCloud Experience (AWS, Azure, GCP)Scala or Java experienceDatabricks Certified Data Engineer Professional certificationConfluent Kafka and Fivetran experienceImmuta experience alongside Unity CatalogAlation or similar data catalog and lineage toolingDeclarative Automation BundlesPhoton, Liquid Clustering, and Databricks Serverless compute
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances.
-
Senior Data Engineer
Hace 18 horas
workfromhome, santander, Colombia Insight Global Jornada completaInsight Global is seeking a senior data engineer to design, build, and maintain production-grade batch and streaming pipelines using Databricks, Lakeflow Declarative Pipelines, and dbt. You will collaborate with cross-functional teams to deliver analytics-ready datasets and data models, review designs, and mentor junior engineers. Remote role open in Brazil...
-
Senior Python Full-Stack Engineer
Hace 3 días
workfromhome, santander, Colombia Bluelight Jornada completaBluelight is seeking a skilled Full-Stack Engineer to join our rapidly growing team in Colombia. You will own end-to-end software solutions, integrating backend services with modern front-end interfaces to deliver robust financial reporting and data visualization capabilities. Our environment values collaboration, continuous learning, and delivering...
-
Data Engineer
Hace 4 semanas
workfromhome, bogotá, distrito capital, Colombia AgileEngine Jornada completaData Engineer (Lead) AgileEngine, an Inc. 5000 company, invites a senior data engineer to drive large‑scale data strategy and empower millions worldwide. Responsibilities Build consolidated data foundations and dashboards for workforce analytics. Develop single source of truth for business data, ensuring accuracy and consistency. Implement and...
-
Remote Senior Enterprise AI
Hace 2 días
workfromhome, santander, Colombia Coderio | Software Company Jornada completaCoderio designs and delivers scalable digital solutions for global companies. We are seeking a Senior Enterprise AI & Automation Engineer to design, build, and operate intelligent workflows and conversational agents at scale across cloud environments. You will own end-to-end lifecycle of AI solutions, integrate with enterprise data platforms like Snowflake,...
-
workfromhome, santander, Colombia Bluelight Jornada completaBluelight is a leading software consultancy seeking a senior backend engineer to design and deliver high-quality applications. You will build low-latency AWS API services, RESTful interfaces, and secure multi-tenant data models while collaborating with cross-functional teams. Required 5+ years of backend development, expertise in...
-
Senior ML Engineer
Hace 3 días
workfromhome, santander, Colombia Coderio | Software Company Jornada completaCoderio busca un Senior Machine Learning Engineer para liderar un equipo de Data & Machine Learning y dirigir el desarrollo, entrenamiento, despliegue y monitoreo de modelos en AWS. La posición implica mentoría a perfiles junior, implementación de buenas prácticas de MLOps y una visión orientada a productos. Ofrecemos entorno remoto, proyectos...
-
Sr Machine Learning Engineer
Hace 3 días
workfromhome, santander, Colombia Coderio | Software Company Jornada completaWe may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment....
-
Senior Agentic AI Developer
Hace 2 días
workfromhome, santander, Colombia Coderio | Software Company Jornada completaAbout Us Coderio designs and delivers scalable digital solutions for global companies. With a strong technical foundation and a product-oriented mindset, our teams lead complex software projects from architecture to execution. We value autonomy, clear communication, and technical excellence. We work closely with international teams and partners, creating...
-
Senior Agentic Ai Developer
Hace 1 semana
workfromhome, huila, Colombia Coderio Jornada completaSenior Agentic AI Developer About Us Coderio designs and delivers scalable digital solutions for global companies. With a strong technical foundation and a product-oriented mindset, our teams lead complex software projects from architecture to execution. We value autonomy, clear communication, and technical excellence. We work closely with international...
-
Remote Enterprise AI
Hace 2 semanas
workfromhome, santander, Colombia Coderio Jornada completaCoderio is seeking a Senior Enterprise AI & Automation Engineer to design, build, and operate intelligent workflows and conversational agents at scale. You will own the end-to-end lifecycle of mission-critical AI solutions, integrating with enterprise data platforms like Snowflake and Azure, and ensuring robust observability in cloud environments. If you...