Senior Big Data Engineer with Databricks

hace 3 días


Desde casa, Colombia EPAM Systems A tiempo completo

We are seeking a remote Senior Big Data Engineer with expertise in Databricks to join our innovative team.

The ideal candidate should have extensive experience in Spark/Scala and AWS, as well as a solid foundation in Python.

In this position, you will be responsible for designing, developing, and deploying large-scale data processing systems with Databricks. You will also be responsible for optimizing data pipelines, monitoring performance, and resolving any related issues. The successful candidate should be able to collaborate closely with other teams, evaluate technical trade-offs, and ensure high-quality solutions are delivered.

Responsibilities

  • Design, develop and maintain high-performance data processing systems using Databricks
  • Optimize data pipelines and monitor their performance regularly
  • Identify and troubleshoot issues that occur during data processing
  • Collaborate with other teams to integrate data solutions into existing platforms
  • Evaluate technical trade-offs and provide recommendations to improve the platform's performance and scalability

Requirements

  • Minimum 3 years of relevant experience in Data Software engineering
  • Expertise in DSE Python, AWS, and Databricks
  • Solid foundation in Spark/Scala and Elastic
  • Excellent communication skills and the ability to collaborate with cross-functional teams
  • Fluent in English with an Upper-Intermediate level (B2+)

Nice to have

  • Experience in Apache Airflow and Python


  • Desde casa, Colombia EPAM Systems A tiempo completo

    We are seeking a highly experienced remote Senior Data Engineer with expertise in Databricks to design and develop custom software solutions for our project. The ideal candidate must be able to deliver robust, scalable and reusable solutions, possess a mastery in engineering. The Senior Data Engineer must also be proactive, a team player and possess...

  • Senior Data Engineer

    hace 2 semanas


    Desde casa, Colombia Gorilla Logic A tiempo completo

    **Senior Data Engineer** Gorilla Logic is looking for a Senior Data Engineer, who will work with a team of engineers developing our client’s system. This is a unique and highly technical role, requiring strong development experience in delivering leading-edge solutions. Our environment will require you to work effectively with your teammates, of course....

  • Senior Data Engineer

    hace 6 días


    Desde casa, Colombia Provectus A tiempo completo

    We are seeking a talented and experienced** Senior Data Engineer** to join our team at Provectus. You will encounter numerous technical challenges and have the opportunity to contribute to exciting open-source projects (e.g., ODD, UI for Kafka), build internal solutions, and engage in R&D activities, providing an excellent environment for professional...


  • Desde casa, Colombia EPAM Systems A tiempo completo

    We are seeking a highly skilled Senior Data Software Engineer to join our remote team, working on a cutting-edge project that involves designing and implementing data ingestion solutions using Cloud Native, Big Data related technologies.In this position, you will be responsible for managing code review and dev testing of solutions to ensure they meet best...


  • Desde casa, Colombia EPAM Systems A tiempo completo

    We are seeking a skilled Senior Data Software Engineer to join our remote team, working on an exciting project that involves designing, implementing, and managing our data architecture, pipelines, and systems.In this position, you will collaborate with cross-functional teams to ensure effective data storage, retrieval, and analysis. You will play a key role...


  • Desde casa, Colombia EPAM Systems A tiempo completo

    We are seeking an experienced remote Senior Data Developer Python (Databricks) to join our team. The ideal will be responsible for designing and implementing end-to-end data solutions, ensuring data quality and providing technical guidance to junior developers. To excel in this role, you should have strong expertise in Python, Databricks, and...

  • Senior Data Engineer

    hace 3 días


    Desde casa, Colombia _coderio A tiempo completo

    About CoderioCoderio designs and delivers scalable digital solutions for global businesses. With a strong technical foundation and a product mindset, our teams lead complex software projects from architecture to execution. We value autonomy, clear communication, and technical excellence. We work closely with international teams and partners, building...


  • Desde casa, Colombia EPAM Systems A tiempo completo

    RESPONSIBILITIES - Lead complex and challenging projects that involve working with Big Data tools and technologies such as Apache Hadoop, Apache Hive, and Apache Spark - Design, develop, and deploy high-performance, scalable, and reliable software systems using Java - Mentor junior engineers and lead by example - Interface consistently with tech leadership...


  • Desde casa, Colombia AspenView Technology Partners A tiempo completo

    Build the Future with AspenView Technology PartnersAt AspenView, we are passionate about transforming the way organizations approach technology. We specialize in creating high-performing, nearshore IT teams to help North American clients innovate faster and more efficiently. As we continue to grow, we're looking for exceptional people to join our team and...


  • Desde casa, Colombia EPAM Systems A tiempo completo

    RESPONSIBILITIES - Develop and maintain complex data pipelines using Hadoop, Hive, and Spark - Collaborate with cross-functional teams to define and implement RESTful APIs and service-oriented architectures - Write automated tests and perform code reviews to ensure high-quality code - Participate in Agile development methodologies such as Scrum and Kanban to...