Senior Java Data Pipeline Engineer

hace 5 meses


Desde casa, Colombia EPAM Systems A tiempo completo

We are looking for an experienced Senior Java Data Pipeline Engineer to join our team remotely.

In this role, you will be responsible for designing and implementing robust data pipelines using Java and Apache Beam in the Google DataFlow environment to process large volumes of data efficiently. You will work with the Spring Framework, which is a microservices that supports our pipelines. You will also utilize Google Cloud Platform services to deploy and manage data pipelines, ensuring high availability and reliability. You will collaborate with data scientists and analysts to understand data requirements and implement solutions that support data modeling, mining, and extraction processes. You will optimize existing data pipelines for performance and scalability, identify bottlenecks, and implement improvements. You will develop and maintain documentation for data pipeline architectures, design decisions, and operational procedures. You will also ensure data integrity and compliance with data governance and security policies throughout the data processing lifecycle.

RESPONSIBILITIES
- Design and implement robust data pipelines using Java and Apache Beam in the Google DataFlow environment to process large volumes of data efficiently
- Work with the Spring Framework, which is a microservices that supports our pipelines
- Utilize Google Cloud Platform services to deploy and manage data pipelines, ensuring high availability and reliability
- Collaborate with data scientists and analysts to understand data requirements and implement solutions that support data modeling, mining, and extraction processes
- Optimize existing data pipelines for performance and scalability, identify bottlenecks, and implement improvements
- Develop and maintain documentation for data pipeline architectures, design decisions, and operational procedures
- Ensure data integrity and compliance with data governance and security policies throughout the data processing lifecycle
- Monitor pipeline performance and implement logging and alerting mechanisms to detect and address issues proactively

**REQUIREMENTS**:

- Bachelor's or Master's degree in Computer Science, Engineering, Information Technology, or a related field
- At least 3 years of experience in data pipeline development, with a strong background in Java and cloud-based data processing technologies
- Proven track record of designing, implementing, and optimizing data pipelines for processing large data sets in a cloud environment
- Hands-on experience with Google DataFlow and Apache Beam for building and managing data pipelines
- Experience with GCP services, particularly those related to data storage, processing, and analytics
- Proficiency in using version control systems, such as Git, for code management and collaboration
- Excellent communication skills in English at a B2+ level

WE OFFER
- Learning Culture - We want you to be the best version of yourself, that is why we offer unlimited access to learning platforms, a wide range of internal courses, and all the knowledge you need to grow professionally
- Health Coverage - Health and wellness are important, that is why we have you and up to four family members in a premiere health plan. We have a couple of options, so you can choose what is best for you and your family
- Visual Benefit - Seeing your work for us would be a sight for sore eyes. We want your vision to always be at 100% which is why we offer up to $200.000 COP for any visual health expenses
- Life Insurance Plan - We have partnered with MetLife to offer a full-coverage Ife insurance plan. So, your family is covered, even if you are gone
- Medical Leave Coverage - We are one of the few companies that cover 100% of your medical leave, for up to 90 days. Your health is the most important thing to us
- Professional Growth Opportunities - We have designed a highly competitive and complete development process, where you will have all the tools to get where you have always wanted to be, personally and professionally
- Stock Option Purchase Plan - As an EPAMer you can be more than just an employee, you will also have the opportunity to purchase stock at a reduced price and become a part owner of our organization
- Additional Income - Besides your regular salary, you will also have the chance to earn extra income by referring talent, being a technical interviewer, and many more ways
- Community Benefit - You will be part of a worldwide community of over 50,000 employees, where you can learn, challenge yourself, stand out, and share your knowledge and experience with multicultural teams
- Are you open to relocation? - If you want to relocate to another country and we have the right project, we will assist you every step of the way, to help you and your family, reach your new home



  • Desde casa, Colombia EPAM Systems A tiempo completo

    We are currently seeking a Lead Java Data Pipeline Engineer to join our remote team for an exciting project focused on developing and implementing robust data pipelines using Java and Apache Beam in the Google DataFlow environment to process large volumes of data efficiently. In this role, you will be responsible for designing and optimizing data pipelines...

  • Senior Data Engineer

    hace 5 meses


    Desde casa, Colombia Gorilla Logic A tiempo completo

    **Senior Data Engineer (Java/GCP)** **Responsibilities** - Design, build and maintain scalable and efficient data architectures, including databases, data warehouses, data lakes, data marts, and other storage solutions. - Design, build, and maintain robust data pipelines for the extraction, transformation, and loading (ETL) of data from various sources to...

  • Senior Data Engineer

    hace 5 meses


    Desde casa, Colombia Gorilla Logic A tiempo completo

    **Senior Data Engineer (Java/GCP)** **Responsibilities** - Design, build and maintain scalable and efficient data architectures, including databases, data warehouses, data lakes, data marts, and other storage solutions. - Design, build, and maintain robust data pipelines for the extraction, transformation, and loading (ETL) of data from various sources to...

  • Senior Data Engineer

    hace 5 meses


    Desde casa, Colombia Growth Acceleration Partners A tiempo completo

    **Description**: We are seeking a Senior Data Engineer with a proven record of accomplishment in the design, development, maintenance, and operation of scalable, high-performance Data solutions primarily using PostgreSQL and SQL Server secondarily. This is a hands-on position that includes developing data technologies with Technology Team Leadership and...

  • Data Engineer

    hace 5 meses


    Desde casa, Colombia Formula.Monks A tiempo completo

    Formula.Monks is an Engineering and AI technology-driven consulting firm, and we offer IT solutions and consulting services. We consult, build, and scale the world’s most innovative brands. Are you a data engineer looking to join a leading technology company? Are you passionate about data and everything it powers? Are you ready to help people travel, go...

  • Senior Data Engineer

    hace 5 meses


    Desde casa, Colombia Gorilla Logic A tiempo completo

    **Senior Data Engineer** **Responsibilities** - Design, build and maintain scalable and efficient data architectures, including databases, data warehouses, data lakes, data marts, and other storage solutions. - Design, build, and maintain robust data pipelines for the extraction, transformation, and loading (ETL) of data from various sources to storage and...

  • Senior Data Engineer

    hace 4 meses


    Desde casa, Colombia Gorilla Logic A tiempo completo

    **Senior Data Engineer** Gorilla Logic is looking for a Senior Data Engineer, who will work with a team of engineers developing our client’s system. This is a unique and highly technical role, requiring strong development experience in delivering leading-edge solutions. Our environment will require you to work effectively with your teammates, of course....


  • Desde casa, Colombia Gorilla Logic A tiempo completo

    **Senior Backend Engineer (Kotlin)** Gorilla Logic is looking for a senior backend engineer, you will play a crucial role in designing, implementing, and maintaining our client's data architecture, ensuring the availability and about data, possesses strong technical skills, and has experience developing scalable data solutions. But your real success will...

  • Senior Data Engineer

    hace 5 meses


    Desde casa, Colombia Provectus A tiempo completo

    We are seeking a talented and experienced** Senior Data Engineer** to join our team at Provectus. You will encounter numerous technical challenges and have the opportunity to contribute to exciting open-source projects (e.g., ODD, UI for Kafka), build internal solutions, and engage in R&D activities, providing an excellent environment for professional...

  • Data Engineer

    hace 5 meses


    Desde casa, Colombia TEAM International Services A tiempo completo

    Our client is a global professional services firm committed to delivering quality in assurance, advisory, and tax services. Financial Crime team works at the forefront of risk management, leveraging advanced technologies and analytics to combat financial crimes and safeguard our clients' interests. Data Pipeline Development: - Design and implement robust,...

  • Data Engineer

    hace 5 meses


    Desde casa, Colombia Formula.Monks A tiempo completo

    We are lookin for a strategy-obsessed, problem-solving, and detail-loving** Data Engineer** to join the team! With solid experience pulling data from various databases into database objects. The specific tittle is **Senior Marketing Infrastructure & Automation Engineer.** This role will act as the senior technical lead on the team supporting the continuous...

  • Data Engineer

    hace 4 meses


    Desde casa, Colombia Interfell A tiempo completo

    Nuestro cliente aliado es una empresa chilena enfocada en brindar servicios de soluciones integrales a sus clientes, ellos apoyan en las áreas de Transformación Digital, Infraestructura, gestión y desarrollo de proyectos. Actualmente buscan un Data Engineer que se integraría en una célula de trabajo para colaborar en un proyecto basado en Snowflake que...

  • Senior Kotlin Engineer

    hace 5 meses


    Desde casa, Colombia Gorilla Logic A tiempo completo

    **Senior Backend Engineer (Kotlin)** **Responsibilities** - Mentor fellow developers - Work with DevOps and QA to build a quality focused CI/CD pipeline - Responsible for code reviews, testing and delivery of high-quality maintainable code - Work in an Agile environment to define, estimate and work user stories - Proficient English and communications skills...


  • Desde casa, Colombia Gorilla Logic A tiempo completo

    **Senior Fullstack Developer (Java/Vue)** **Responsibilities** - Work with an agile team to build, maintain and optimize our client’s web services and other backend systems - Work with DevOps and QA to build a quality focused CI/CD pipeline - Build out unit tests to ensure that the code is reasonably tested prior to shipment - Work in an Agile environment...

  • Senior Data Engineer

    hace 5 meses


    Desde casa, Colombia Blanc Labs A tiempo completo

    Blanc Labs is a premier partner for global enterprises, leading the way in digitization, automation, and the development of next-generation digital products and services. Our expertise in digital transformation powers businesses to accelerate service delivery, drive customer engagement, and foster growth. **Essential Duties and Responsibilities**: -...

  • Data Engineer

    hace 5 meses


    Desde casa, Colombia Bold A tiempo completo

    **Bold** Nuestra compañía fue fundada en Mayo de 2019 por un equipo de personas increíbles y con una experiência única, el grupo de fundadores está conformado por los creadores de PayU Latam y otras empresas expertas en tecnología financiera. Estamos creando soluciones de pago y de banca para MiPymes, independientes y emprendedores en Colombia....

  • Senior Data Engineer

    hace 5 meses


    Desde casa, Colombia Allshore Virtual Staffing A tiempo completo

    **About AllShore Virtual Staffing**: AllShore Virtual Staffing is a leading remote staffing company, offering top-tier professionals working 100% remote to businesses worldwide. Specializing in IT and software development, design, administrative support, digital marketing, and more. AllShore connects organizations with skilled talent to meet diverse business...

  • Senior Data Engineer

    hace 5 meses


    Desde casa, Colombia Gorilla Logic A tiempo completo

    **Senior Data Engineer** Gorilla Logic is looking for a Sr. Data Engineer, who will assist in organizing our client's system data into dashboards and on demand reports. This is a unique and highly technical role, requiring strong database and reporting experience in delivering leading-edge solutions. Our environment will require you to work effectively with...

  • Senior Data Engineer

    hace 5 meses


    Desde casa, Colombia AgileEngine A tiempo completo

    **What you will do** - Build data pipelines(ETL flows) to connect different sources of data together - Designing data structures for analytics - Identification of performance bottlenecks - Serve as a go-to Data Engineering consultant for other team members - Optimize SQL queries - Communication with Engineering & Product management - Alignment with existing...

  • Senior Java Developer

    hace 5 meses


    Desde casa, Colombia EPAM Systems A tiempo completo

    RESPONSIBILITIES - Design and implement robust data pipelines using Java and Apache Beam in the Google DataFlow environment to process large volumes of data efficiently - Optimize existing data pipelines for performance and scalability, identify bottlenecks, and implement improvements - Work with the Spring Framework to develop microservices that support our...