Senior Data Engineer with expertise in Cloud Architecture

hace 2 días


Cali, Valle del Cauca, Colombia Endava A tiempo completo

Job Description

At Endava, our data team has expertise across engineering, analysis, architecture, modeling, machine learning, artificial intelligence, and data science. We are responsible for transforming raw data into actionable insights, building robust data infrastructures, and enabling data-driven decision-making and innovation through advanced analytics and predictive modeling.

As a Senior Data Engineer at Endava, you will be responsible for developing and implementing data pipelines, collaborating with data architects, and ensuring data quality and integrity. You will also support data migration projects and contribute to agile development processes.

Responsibilities:

  • Work closely with the Data Analyst/Data Scientist to understand evolving needs and define the data processing flow or interactive reports.
  • Discuss with the stakeholders from other teams to better understand how data flows are used within the existing environment.
  • Propose solutions for the cloud-based architecture and deployment flow.
  • Design and build processes, data transformation, and metadata to meet business requirements and platform needs.
  • Design and propose solutions for the Relational and Dimensional Model based on platform capabilities.
  • Develop, maintain, test, and evaluate big data solutions.
  • Focus on production status and data quality of the data environment.
  • Pioneer initiatives around data quality, integrity, and security.

Qualifications:

  • +5 years of experience in Data Engineering.
  • Proficiency in Apache Spark
  • Proficiency in Python.
  • Some experience leading IT projects and stakeholder management.
  • Experience implementing ETL/ELT process and Data pipelines.
  • Experience with Snowflake.
  • Strong SQL scripting experience.
  • Background and experience with cloud data technologies and tools.
  • Familiar with data tools and technologies like:
  • Spark, Hadoop, Apache beam, Dataproc or similar.
  • BigQuery, Redshift, or other Data warehouse tools.
  • Real-time pipelines with Kinesis or Kafka.
  • Batch processing.
  • Serverless processing.
  • Strong analytic skills related to working with structured and unstructured data sensibilities.


  • Cali, Valle del Cauca, Colombia Endava A tiempo completo

    Job Title: Senior Data EngineerEndava is seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for developing and implementing data pipelines, collaborating with data architects, and ensuring data quality and integrity.Responsibilities:Work closely with the Data Analyst/Data Scientist to understand...


  • Cali, Valle del Cauca, Colombia America Steel Trade Corporation A tiempo completo

    About the RoleAs a Senior Software Engineer - Cloud Architecture, you will be responsible for designing and implementing scalable cloud solutions using AWS services. You will work closely with our team of experts to ensure that our cloud infrastructure meets the highest standards of security, reliability, and performance.Key ResponsibilitiesDesign and...


  • Cali, Valle del Cauca, Colombia Listos A tiempo completo

    As a senior software engineer, you will work with a talented team to develop and maintain sophisticated software systems. Your expertise in machine learning and data analysis will be invaluable in driving business growth and improving operational efficiency. You will be responsible for designing and implementing scalable software solutions, collaborating...

  • Senior Cloud Engineer

    hace 7 días


    Cali, Valle del Cauca, Colombia Encora A tiempo completo

    About the RoleEncora is seeking a Senior Cloud Engineer to join our team. As a Senior Cloud Engineer, you will be responsible for designing and implementing cutting-edge cloud solutions to meet our business requirements. You will work closely with our development and operations teams to ensure the successful delivery of our software projects.Key...


  • Cali, Valle del Cauca, Colombia Soportica A tiempo completo

    About this role:We are seeking a talented Software Engineer with expertise in cloud infrastructure management to join our team. As a key member of our infrastructure team, you will be responsible for designing, implementing, and managing cloud-based infrastructure solutions. Your technical expertise will help us build a scalable and secure cloud...


  • Cali, Valle del Cauca, Colombia Reckitt Benckiser Group A tiempo completo

    About the RoleWe are seeking a talented Software Engineer to join our team. In this role, you will be responsible for designing and implementing scalable architecture solutions to meet the needs of our growing business.


  • Cali, Valle del Cauca, Colombia Icesi A tiempo completo

    About the Role: We are seeking a skilled Cloud Solutions Expert to join our team at «{company«}. As a Cloud Solutions Expert, you will be responsible for designing and implementing scalable cloud-based systems, ensuring high availability and security. Your expertise in cloud services will enable us to deliver innovative solutions to our clients. Key...


  • Cali, Valle del Cauca, Colombia Aseing A tiempo completo

    Key Responsibilities:• Design and implement cloud architecture solutions for software development projects• Lead a team of cloud infrastructure engineers to ensure smooth project delivery• Collaborate with cross-functional teams to ensure alignment with company goals and objectivesRequirements:• 5+ years of experience in cloud infrastructure...

  • Senior Data Engineer

    hace 2 semanas


    Cali, Valle del Cauca, Colombia Cuesta Partners A tiempo completo

    Cuesta Partners is a technology strategy consulting firm that helps organizations navigate their technology journey. We support firms in various stages of growth, from considering acquisition to developing new products and adopting modern data technologies. Our team guides leadership in creating scalable strategies for their technology business, including...


  • Cali, Valle del Cauca, Colombia POLITECNICO INTERNACIONAL DE OCCIDENTE A tiempo completo

    About the RoleWe are seeking a skilled Software Engineer with expertise in Java to join our team at {company}. The ideal candidate will have a strong background in software development and be proficient in Java.Key ResponsibilitiesDesign, develop, and maintain scalable Java applicationsCollaborate with cross-functional teams to identify and prioritize...


  • Cali, Valle del Cauca, Colombia Torre A tiempo completo

    Job Title: Senior Software Engineer - Cloud InfrastructureWe are seeking a highly skilled Senior Software Engineer to join our team in developing and maintaining cloud-based infrastructure. The ideal candidate will have a strong background in cloud computing and software development, with expertise in designing and implementing scalable and secure cloud...


  • Cali, Valle del Cauca, Colombia Calidulces Sas A tiempo completo

    About the Role: We're seeking a skilled Senior Software Engineer with expertise in Python to join our team at "{company}". This is an exciting opportunity for a talented professional to contribute to the development of scalable software solutions. The ideal candidate will have a solid understanding of software design patterns, data structures, and...


  • Cali, Valle del Cauca, Colombia Todo Acabados Eje S.A.S A tiempo completo

    At our company, we are seeking a highly skilled Sr. Software Engineer to lead the development of our cloud-based systems. The ideal candidate will have expertise in cloud-based systems and agile methodologies, with a strong focus on delivering high-quality software solutions.The successful candidate will be responsible for designing, developing, and...


  • Cali, Valle del Cauca, Colombia Berlitz Colombia A tiempo completo

    We are looking for a skilled Cloud Architecture professional to join our team at {company}. As a key member of our infrastructure team, you will be responsible for designing, building, and maintaining scalable cloud-based systems.Design and implement cloud-based architecture solutions using AWS or Azure.Develop and maintain cloud infrastructure using...


  • Cali, Valle del Cauca, Colombia Zagamotos del pacifico sas A tiempo completo

    Job Summary:We are seeking a highly skilled Senior Software Engineer to join our team. The ideal candidate will have expertise in cloud technology and a proven track record of delivering complex software solutions.Responsibilities:* Design, develop, and deploy cloud-based software solutions* Collaborate with cross-functional teams to identify business needs...


  • Cali, Valle del Cauca, Colombia Encora Inc. A tiempo completo

    **Job Overview**Encora is a global company that offers Software and Digital Engineering solutions. Our practices include Cloud Services, Product Engineering & Application Modernization, Data & Analytics, Digital Experience & Design Services, DevSecOps, Cybersecurity, Quality Engineering, AI & LLM Engineering, among others.**About the Role**We are seeking a...


  • Cali, Valle del Cauca, Colombia Orbidi A tiempo completo

    As a Senior Software Engineer, you will be responsible for leading the development of data analysis tools and ensuring their accuracy and efficiency. Your expertise in data analysis will be instrumental in driving business decisions and informing strategic initiatives. If you have experience in software development and a passion for data analysis, we...


  • Cali, Valle del Cauca, Colombia CFC PROCESADORA DE ALIMENTOS SAS A tiempo completo

    Job Title: Senior Software Engineer - Cloud ComputingJob Description: We are seeking a highly skilled Senior Software Engineer to lead our cloud computing team. The ideal candidate will have experience in designing and implementing scalable cloud-based systems.Responsibilities:Design and implement cloud-based systemsLead a team of software...


  • Cali, Valle del Cauca, Colombia AyM Ingenieros SpA A tiempo completo

    Job Title: Cloud Computing ProfessionalWe are seeking a skilled Cloud Computing Professional to join our team at {company}.The ideal candidate will have a strong background in software development and cloud computing, with experience in designing and implementing scalable cloud-based systems. Key responsibilities will include:Designing and developing...


  • Cali, Valle del Cauca, Colombia Endava A tiempo completo

    Company OverviewEndava is a leading technology and digital transformation company with a strong presence in the industry. Our team has expertise across engineering, analysis, architecture, modeling, machine learning, artificial intelligence, and data science.