Data Engineering Expert with Cloud and Big Data Experience

hace 2 semanas


Bogotá, Bogotá D.E., Colombia Endava Limited A tiempo completo

Company Overview

At Endava Limited, we harness technology to drive meaningful change. For over two decades, we have been combining world-class engineering, industry expertise, and a people-centric mindset to create dynamic platforms and intelligent digital experiences that drive innovation and transform businesses.

We consult and partner with leading brands from various industries to bring projects from prototype to real-world impact. Our global shift is about doing work that matters.

Salary

The estimated annual salary for this position is $120,000-$180,000, depending on experience and qualifications.

Job Description

As a Senior Data Engineer at Endava Limited, you will be responsible for developing and implementing data pipelines, collaborating with data architects, and ensuring data quality and integrity.

You will also support data migration projects and contribute to agile development processes.

Key Responsibilities:

  • Work closely with the Data Analyst/Data Scientist to understand evolving needs and define the data processing flow or interactive reports.
  • Discuss with stakeholders from other teams to better understand how data flows are used within the existing environment.
  • Propose solutions for cloud-based architecture and deployment flow.
  • Design and build processes, data transformation, and metadata to meet business requirements and platform needs.
  • Develop, maintain, test, and evaluate big data solutions.
  • Focusing on production status and data quality of the data environment.
  • Pioneer initiatives around data quality, integrity, and security.

Requirements:

  • +5 years of experience in Data Engineering.
  • Proficiency in Apache Spark.
  • Proficiency in Python.
  • Some experience leading IT projects and stakeholder management.
  • Experience implementing ETL/ELT process and Data pipelines.
  • Experience with Snowflake.
  • Strong SQL scripting experience.
  • Background and experience with cloud data technologies and tools.
  • Familiar with data tools and technologies like Spark, Hadoop, Apache beam, Dataproc or similar.
  • BigQuery, Redshift, or other Data warehouse tools.
  • Real-time pipelines with Kinesis or Kafka.
  • Batch processing.
  • Serverless processing.

Benefits

  • Competitive salary package.
  • Share plan.
  • Company performance bonuses.
  • Value-based recognition awards.
  • Referral bonus.

Global Benefits

  • Career coaching.
  • Global career opportunities.
  • Non-linear career paths.
  • Internal development programmes for management and technical leadership.
  • Complex projects.
  • Rotations.
  • Internal tech communities.
  • Training.
  • Certifications.
  • Coaching.
  • Online learning platforms subscriptions.
  • Pass-it-on sessions.
  • Workshops.
  • Conferences.

  • Data Engineering Expert

    hace 4 semanas


    Bogotá, Bogotá D.E., Colombia Scotiabank A tiempo completo

    Job SummaryWe are seeking a highly skilled Data Engineer Associate to join our team at Scotiabank. This is a challenging role that requires strong technical skills and the ability to work collaboratively with cross-functional teams.About the RoleThe Data Engineer will be responsible for designing, implementing, and maintaining large-scale data pipelines and...


  • Bogotá, Bogotá D.E., Colombia Heinsohn Business Technology A tiempo completo

    About Heinsohn Business TechnologyWe are a leading technology company dedicated to delivering innovative solutions. At Heinsohn, we're seeking a skilled Cloud Data Optimization Expert to join our team.Job OverviewAs a Cloud Data Optimization Expert, you will play a critical role in optimizing our cloud infrastructure and data workflows. Your expertise will...


  • Bogotá, Bogotá D.E., Colombia Slalom Consulting A tiempo completo

    We are excited to launch in Colombia, expanding our presence in the region and enhancing job postings with English and Spanish by early 2025. Our team at Slalom Build co-creates custom software, data, and cloud products with clients who are ready to accelerate their digital transformation. We're passionate about technology, driven by its potential as we help...


  • Bogotá, Bogotá D.E., Colombia Ingepsy A tiempo completo

    Job Title: Data Engineering SpecialistAbout IngepsyIngepsy is a forward-thinking organization dedicated to harnessing the power of data to drive innovation and growth. Our team of experts is passionate about designing and implementing cutting-edge solutions that meet the evolving needs of our clients.Salary Range: $120,000 - $180,000 per annum, depending on...


  • Bogotá, Bogotá D.E., Colombia Softwareone Deutschland Gmbh A tiempo completo

    Are you a technical expert in cloud platforms and AI solutions? Do you have experience in providing guidance to sales teams and customers on complex data and AI projects?We are seeking an experienced Data Solutions Architect for Cloud and AI to join our team at Softwareone Deutschland Gmbh. As a Data Solutions Architect, you will play a crucial role in...


  • Bogotá, Bogotá D.E., Colombia Scotiabank A tiempo completo

    **Company Overview:** Scotiabank is a leading financial institution committed to delivering exceptional banking services to its customers. Our team of dedicated professionals works tirelessly to ensure that our clients receive the best possible experience. Salary: $120,000 - $180,000 per year Job Description:We are seeking an experienced Data Engineer to...


  • Bogotá, Bogotá D.E., Colombia Scopeworker A tiempo completo

    About Scopeworker Business IntelligenceAt Scopeworker, we are revolutionizing the Procure-Execute-Pay lifecycle of complex supplier services through our innovative enterprise SaaS platform. Our mission is to automate this process and enable an 'Uber' style marketplace for enterprises, providing real-time business intelligence that is truly unique.About the...


  • Bogotá, Bogotá D.E., Colombia TelevisaUnivision A tiempo completo

    Company OverviewTelevisaUnivision is the leading Spanish-language media company in the world, investing in its content, people, and properties across digital, streaming, social, audio, linear, and live events.We're growing our offerings, building on the launch of our successful streaming platform ViX, which requires a team of skilled data engineers to build...

  • Cloud Data Architect

    hace 2 meses


    Bogotá, Bogotá D.E., Colombia Endava Limited A tiempo completo

    At Endava Limited, we're harnessing technology to drive meaningful change. Our data team has expertise across engineering, analysis, architecture, modeling, machine learning, artificial intelligence, and data science. This discipline is responsible for transforming raw data into actionable insights, building robust data infrastructures, and enabling...


  • Bogotá, Bogotá D.E., Colombia Scotiabank A tiempo completo

    Job Description:This role involves designing, developing, and implementing Extract, Transform, Load (ETL) solutions using various tools such as SSIS, DataStage, and PLSQL. The ideal candidate will have a strong understanding of data processes, including aggregating, cleansing, and enrichment, as well as experience with Cloud solutions like MS Azure...


  • Bogotá, Bogotá D.E., Colombia Provectus It, Inc. A tiempo completo

    About ProvectusAt Provectus, we empower businesses to leverage the full potential of AI and ML to drive transformation. Our focus is on crafting innovative data and ML infrastructure solutions that unlock end-to-end AI transformations across industries such as Healthcare & Life Sciences, Retail & CPG, Media & Entertainment, Manufacturing, and Internet...


  • Bogotá, Bogotá D.E., Colombia Slalom Consulting A tiempo completo

    We are excited to launch our Data Engineering capability in Colombia, offering enhanced job postings with English and Spanish in early 2025. Our team is passionate about co-creating custom software, data, and cloud products with clients who want to accelerate their digital transformation.About Slalom BuildWho We AreSlalom Build is a highly scalable,...


  • Bogotá, Bogotá D.E., Colombia Talan A tiempo completo

    Job OverviewWe are seeking a highly skilled Big Data Solutions Architect to join our team at Talan. This role will play a key part in developing and implementing innovative big data solutions that drive business success.Key ResponsibilitiesDesign, develop, and implement end-to-end ETL processes with Spark/Scala, ensuring seamless data transfer and...


  • Bogotá, Bogotá D.E., Colombia Buscojobs Colombia A tiempo completo

    Role OverviewWe are seeking a skilled Cloud Data Solutions Architect to join our team in Colombia. As a key member of our sales team, you will play a crucial role in collaborating with customers to understand their requirements and provide tailored solutions.About the RoleIn this full-time position, you will be responsible for providing technical support,...


  • Bogotá, Bogotá D.E., Colombia Endava Limited A tiempo completo

    Company OverviewWe are a global company that harnesses technology to drive meaningful change. With over two decades of experience, we combine world-class engineering with industry expertise and a people-centric mindset to create innovative digital experiences.About the RoleAs a Senior Data Engineer at Endava Limited, you will be responsible for developing...


  • Bogotá, Bogotá D.E., Colombia Publicis Groupe A tiempo completo

    Job Title: Chief Data Engineering Solutions Specialist About Publicis Groupe:At Publicis Global Delivery, we are a continuously evolving machine of creation that aims to become a more efficient and collaborative system. We serve as a cross-media transformation agent, providing centralized expertise across Media, Production, Commerce, Content, Data &...


  • Bogotá, Bogotá D.E., Colombia Within A tiempo completo

    About WITHIN: We are a leading Performance Branding company that drives business growth through innovative marketing strategies. Our integrated model combines creative and media, performance and brand, and across media channels to deliver exceptional results for our clients. With a full suite of offerings, we partner with iconic brands like The North Face,...

  • Senior Data Engineer

    hace 2 semanas


    Bogotá, Bogotá D.E., Colombia Endava Limited A tiempo completo

    Company OverviewAt Endava, we harness technology to drive meaningful change. With a people-centric mindset and world-class engineering expertise, we consult and partner with leading brands to create dynamic platforms and intelligent digital experiences that drive innovation and transform businesses.Job DescriptionWe are seeking a highly skilled Senior Data...


  • Bogotá, Bogotá D.E., Colombia Amadeus A tiempo completo

    Job OverviewWe are seeking an experienced Senior Data Engineer to join our team in Hospitality BI. This role will involve designing and implementing data pipelines to provide insights into market performance and traveler trends. You will work with a variety of data sources, including industry metrics and customer information.About the RoleThis is a...


  • Bogotá, Bogotá D.E., Colombia Medtronic A tiempo completo

    Are you passionate about data architecture and design? Do you enjoy working with cloud-based technologies like Snowflake, Informatica Cloud, Coalesce, DBT, Airflow, Oracle, and Python?We are seeking a talented Cloud Data Architect to join our team at Medtronic. As a key member of our data architecture team, you will be responsible for designing and building...