Azure Databricks Big Data Engineer

hace 1 semana


Cundinamarca, Colombia Sofka A tiempo completo

Sofka is a technology ally that transforms people's lives through innovation and reliability. We are seeking an experienced Azure Databricks Big Data Engineer to join our team of like-minded professionals.

Job Description

The successful candidate will be responsible for designing, implementing, and optimizing big data solutions using Azure Databricks. This role involves leveraging data to drive insights and innovation, ensuring efficient data processing and integration across cloud environments.

Key Responsibilities:
  • Design and deploy scalable data pipelines using Azure Databricks
  • Integrate data from various sources, ensuring seamless data flow
  • Perform data analysis and transform raw data into business-ready formats
  • Optimize data processing workflows for better performance and cost-efficiency
  • Ensure high data quality and implement data governance best practices
  • Collaborate with cross-functional teams to align data strategies with business objectives
Requirements

To be successful in this role, you will need:

  • Proven experience with Azure Databricks, PySpark, and Big Data technologies
  • A strong understanding of Azure services such as Data Lake Storage and Synapse Analytics
  • Proficiency in programming languages like Python or Scala
  • Familiarity with data modeling, ETL processes, and data warehousing concepts
  • Experience with CI/CD pipelines for automated deployments
  • Knowledge of data security protocols and practices
  • Ability to optimize and troubleshoot complex data systems
What We Offer

We offer a permanent contract with opportunities for long-term growth and professional development. Our team is focused on your physical and mental well-being, with a culture of continuous improvement and learning opportunities. We provide a supportive environment where you can design your own career plan and grow with us.

Salary and Benefits

We offer a competitive salary of approximately $120,000 per year, depending on experience. Additional benefits include a culture of continuous improvement, learning opportunities, and a programme designed to enhance your talents, KaizenHub.


  • Databricks Engineer

    hace 2 semanas


    Cundinamarca, Colombia Sofka A tiempo completo

    Job OverviewSofka is seeking an experienced Azure Databricks Engineer to join our team. As a key member of our data engineering group, you will design, implement, and optimize big data solutions using Azure Databricks.Key ResponsibilitiesDesign and deploy scalable data pipelines using Azure DatabricksIntegrate data from various sources for seamless data...

  • Azure Data Engineer

    hace 1 mes


    Bogotá, Cundinamarca, Colombia Mindtech A tiempo completo

    **Mindtech **es la puerta de entrada a proyectos tecnológicos emocionantes e impactantes. Nos especializamos en vincular el talento latinoamericano con oportunidades globales. Nuestro enfoque rápido y eficiente garantiza que nuestros clientes reciban un servicio excepcional y soluciones innovadoras. Con un equipo diverso de más de 70 profesionales...

  • Data Engineer

    hace 3 meses


    Bogotá, Cundinamarca, Colombia Blue Orange Digital A tiempo completo

    **Company Overview**: **Position Overview**: **Responsibilities**: - Work with Databricks, Spark, Python, and other data orchestration and ETL tools to build high-performance data pipelines. - Work with data teams to help design, build, and deploy data platforms in the cloud (Azure, AWS, GCP) and automate their operation. - Work with Azure DevOps, Azure...

  • Senior Data Architect

    hace 3 meses


    Bogotá, Cundinamarca, Colombia Ci&T A tiempo completo

    We are **tech transformation** specialists, we are **CI&T. We combine the disruptive power of Artificial Intelligence with human expertise to support large companies in navigating changes in technology and business. With 30 years of experience, 6,000 workers, offices in 10 countries and talents across 5 continents. We operate in the fields of design,...

  • Data Engineer Ssr

    hace 2 meses


    Bogotá, Cundinamarca, Colombia Mindtech A tiempo completo

    Habilidades Técnicas: - Bases de datos: SQL Server, PostgreSQL, MySQL, NoSQL (MongoDB, Cassandra). - Cloud: Azure (Databricks, Data Factory, Synapse Analytics), AWS (EMR, Glue), GCP (Dataproc). - Lenguajes: Python, SQL, Scala, Java. - Herramientas: ETL (Talend, Informatica), BI (Power BI, Tableau), Orquestación (Airflow, Luigi). - Conceptos: ETL, ELT,...

  • Data Engineer

    hace 4 meses


    Bogotá, Cundinamarca, Colombia Kushki A tiempo completo

    En Kushki, nos enorgullece ser líderes en la industria de pagos, impulsando el cambio y la innovación a través de soluciones que transforman los comercios. Nuestro compromiso con la excelencia y la creatividad nos ha llevado a la vanguardia de nuestro campo, y buscamos constantemente talentos apasionados que deseen hacer una diferencia real en el...

  • Data Engineer

    hace 3 meses


    Bogotá, Cundinamarca, Colombia First Line Software A tiempo completo

    **About the company** We build the company around people - so we are looking for teammates who want to build something big with us, too! Our international team of more than 500 professionals is spread across the United States, Europe, Latin America, Australia, and India. But we are all connected by our innovative thinking and desire to create as one team....

  • Big Data Developer

    hace 1 mes


    Bogotá, Cundinamarca, Colombia Talan A tiempo completo

    **Company Description** Talan is an international advisory group on innovation and transformation through technology, with 5000 employees, and a turnover of 600M€.** We offer our customers a continuum of services to support you at each key stage of your organization's transformation, with 4 main activities: - ** CONSULTING** in management and innovation...


  • Bogotá, Cundinamarca, Colombia World Business Lenders, LLC A tiempo completo

    Business Lenders (WBL) provides general purpose short-term real estate collateralized commercial loans to a broad customer base comprised of small and medium sized businesses throughout the United States that lack access to traditional funding. WBL is a U.S. based company with a** 100% remote workforce**. This is a remote Contract/Consultant position....

  • Data Engineer

    hace 4 meses


    Bogotá, Cundinamarca, Colombia NielsenIQ A tiempo completo

    **Company Description** NIQ is the world’s leading consumer intelligence company, delivering the most complete understanding of consumer buying behavior and revealing new pathways to growth. In 2023, NIQ combined with GfK, bringing together the two industry leaders with unparalleled global reach. Founded in Barcelona in 2001, Netquest is the data...

  • Data Engineer

    hace 4 meses


    Bogotá, Cundinamarca, Colombia NielsenIQ A tiempo completo

    **Company Description** NIQ is the world’s leading consumer intelligence company, delivering the most complete understanding of consumer buying behavior and revealing new pathways to growth. In 2023, NIQ combined with GfK, bringing together the two industry leaders with unparalleled global reach. Founded in Barcelona in 2001, Netquest is the data...

  • Data Analyst

    hace 3 meses


    Bogotá, Cundinamarca, Colombia Capgemini Engineering A tiempo completo

    **Data Analyst - Work from home**: Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading...

  • Azure Data

    hace 1 mes


    Bogotá, Cundinamarca, Colombia SoftwareOne A tiempo completo

    Job Function: Sales Por qué SoftwareOne?: El éxito en SoftwareOne no se define por lo que haces, sino por lo que entregas a nuestros clientes, al negocio y a los colaboradores que te rodean. Los colaboradores de SoftwareOne están llenos de energía, son ágiles y están enfocados en proporcionar Satisfacción al Cliente y resultados de clase mundial....

  • Data Scientist

    hace 3 meses


    Bogotá, Cundinamarca, Colombia Capgemini Engineering A tiempo completo

    **Data Scientist - Work from home**: Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading...

  • Senior Data Engineer

    hace 4 meses


    Bogotá, Cundinamarca, Colombia Prodigious A tiempo completo

    **Company Description** At Publicis Groupe, we are looking for a** Senior Data Engineer **Fluent in English to join our Data Science Hub at Publicis Global Delivery, our talent powerhouse, the global interconnected network that provide offshore & nearshore solutions for our partners - sister companies´ business worldwide. We currently have Hubs in...

  • Data Engineer

    hace 1 mes


    Bogotá, Cundinamarca, Colombia Scotiabank A tiempo completo

    **ID de la solicitud**: 206945 Estamos comprometidos a invertir en nuestros colaboradores y ayudarles a continuar su carrera profesional en ScotiaTech. **Purpose** **Accountabilities**: - Champions a customer focused culture to deepen client relationships and leverage broader Bank relationships, systems and knowledge. - Functions as member of an agile...

  • Data Engineer

    hace 4 semanas


    Bogotá, Cundinamarca, Colombia Scotiabank A tiempo completo

    Estamos comprometidos a invertir en nuestros colaboradores y ayudarles a continuar su carrera profesional en ScotiaTech. **Purpose** **Accountabilities** - Champions a customer focused culture to deepen client relationships and leverage broader Bank relationships, systems and knowledge. - Functions as member of an agile team and helps drive consistent...

  • Azure DevOps Engineer

    hace 4 meses


    Bogotá, Cundinamarca, Colombia Capgemini Engineering A tiempo completo

    **Azure DevOps Engineer - Remote**: **Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading...

  • Data Engineer

    hace 3 semanas


    Bogotá, Cundinamarca, Colombia IntouchCX A tiempo completo

    About IntouchCX IntouchCX is a global leader in customer experience management, digital engagement, and AI and automation solutions. We immerse ourselves in your world with curiosity, creativity, and innovation to deliver exceptional results. For over 20 years, we have scaled with soul to become a disruptive industry leader by building trusted long-term...


  • Cundinamarca, Colombia Scotiabankcolpatria A tiempo completo

    📓 Descripción del PuestoRequisitos del Cargo• Experiencia en Manejo de Lenguaje SQL, Python/R y Microsoft Azure.• Dominio de herramientas de BI y visualización de datos (Power BI, Tableau, etc.).• Familiaridad con herramientas de análisis de datos digitales y métricas web (Google Analytics, plataformas de marketing digital).• Experiencia en el...