Databricks Engineer

hace 2 semanas

Cundinamarca, Colombia Sofka A tiempo completo
Job Overview

Sofka is seeking an experienced Azure Databricks Engineer to join our team. As a key member of our data engineering group, you will design, implement, and optimize big data solutions using Azure Databricks.

Key Responsibilities
  • Design and deploy scalable data pipelines using Azure Databricks
  • Integrate data from various sources for seamless data flow
  • Perform data analysis and transform raw data into business-ready formats
  • Optimize data processing workflows for better performance and cost-efficiency
  • Ensure high data quality and implement data governance best practices
  • Collaborate with cross-functional teams to align data strategies with business objectives
  • Troubleshoot and resolve issues related to data ingestion and processing
Requirements
  • Proven experience with Azure Databricks, PySpark, and Big Data technologies
  • Strong understanding of Azure services such as Data Lake Storage and Synapse Analytics
  • Proficiency in programming languages like Python or Scala
  • Familiarity with data modeling, ETL processes, and data warehousing concepts
  • Experience with CI/CD pipelines for automated deployments
  • Knowledge of data security protocols and practices
  • Ability to optimize and troubleshoot complex data systems
Benefits

We offer a competitive salary of $120,000 per year, a permanent contract, and opportunities for professional growth and career advancement. You can design your own career plan in line with your aspirations and enjoy a close-knit environment while constantly learning.

  • Azure Databricks Big Data Engineer

    hace 1 semana

    Cundinamarca, Colombia Sofka A tiempo completo

    Sofka is a technology ally that transforms people's lives through innovation and reliability. We are seeking an experienced Azure Databricks Big Data Engineer to join our team of like-minded professionals.Job DescriptionThe successful candidate will be responsible for designing, implementing, and optimizing big data solutions using Azure Databricks. This...

  • Data Engineer

    hace 3 meses

    Bogotá, Cundinamarca, Colombia Blue Orange Digital A tiempo completo

    **Company Overview**: **Position Overview**: **Responsibilities**: - Work with Databricks, Spark, Python, and other data orchestration and ETL tools to build high-performance data pipelines. - Work with data teams to help design, build, and deploy data platforms in the cloud (Azure, AWS, GCP) and automate their operation. - Work with Azure DevOps, Azure...

  • Azure Data Engineer

    hace 1 mes

    Bogotá, Cundinamarca, Colombia Mindtech A tiempo completo

    **Mindtech **es la puerta de entrada a proyectos tecnológicos emocionantes e impactantes. Nos especializamos en vincular el talento latinoamericano con oportunidades globales. Nuestro enfoque rápido y eficiente garantiza que nuestros clientes reciban un servicio excepcional y soluciones innovadoras. Con un equipo diverso de más de 70 profesionales...

  • Data Engineer

    hace 4 meses

    Bogotá, Cundinamarca, Colombia Kushki A tiempo completo

    En Kushki, nos enorgullece ser líderes en la industria de pagos, impulsando el cambio y la innovación a través de soluciones que transforman los comercios. Nuestro compromiso con la excelencia y la creatividad nos ha llevado a la vanguardia de nuestro campo, y buscamos constantemente talentos apasionados que deseen hacer una diferencia real en el...

  • Data Engineer Ssr

    hace 2 meses

    Bogotá, Cundinamarca, Colombia Mindtech A tiempo completo

    Habilidades Técnicas: - Bases de datos: SQL Server, PostgreSQL, MySQL, NoSQL (MongoDB, Cassandra). - Cloud: Azure (Databricks, Data Factory, Synapse Analytics), AWS (EMR, Glue), GCP (Dataproc). - Lenguajes: Python, SQL, Scala, Java. - Herramientas: ETL (Talend, Informatica), BI (Power BI, Tableau), Orquestación (Airflow, Luigi). - Conceptos: ETL, ELT,...

  • Senior Machine Learning Engineer

    hace 3 meses

    Bogotá, Cundinamarca, Colombia Capgemini Engineering A tiempo completo

    **Machine Learning Engineer**: Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible. Join us and help the world’s leading...

  • Support Engineer

    hace 1 mes

    Bogotá, Cundinamarca, Colombia IQVIA A tiempo completo

    **Primary Skillset**: - SQL Server, SSIS, C#.Net, VB.Net **Good to have skills** - Hadoop, Spark, Scala, Azure Databricks & Python. **Principal Accountabilities**: - Production support tasks: Picking up incidents in Service Now ticketing tool, acknowledging, responding with proper updates and determine solution. - Good Debugging skills to do the RCA and...