Data Engineering Expert with Cloud and Big Data Experience
hace 2 semanas
Company Overview
At Endava Limited, we harness technology to drive meaningful change. For over two decades, we have been combining world-class engineering, industry expertise, and a people-centric mindset to create dynamic platforms and intelligent digital experiences that drive innovation and transform businesses.
We consult and partner with leading brands from various industries to bring projects from prototype to real-world impact. Our global shift is about doing work that matters.
Salary
The estimated annual salary for this position is $120,000-$180,000, depending on experience and qualifications.
Job Description
As a Senior Data Engineer at Endava Limited, you will be responsible for developing and implementing data pipelines, collaborating with data architects, and ensuring data quality and integrity.
You will also support data migration projects and contribute to agile development processes.
Key Responsibilities:
- Work closely with the Data Analyst/Data Scientist to understand evolving needs and define the data processing flow or interactive reports.
- Discuss with stakeholders from other teams to better understand how data flows are used within the existing environment.
- Propose solutions for cloud-based architecture and deployment flow.
- Design and build processes, data transformation, and metadata to meet business requirements and platform needs.
- Develop, maintain, test, and evaluate big data solutions.
- Focusing on production status and data quality of the data environment.
- Pioneer initiatives around data quality, integrity, and security.
Requirements:
- +5 years of experience in Data Engineering.
- Proficiency in Apache Spark.
- Proficiency in Python.
- Some experience leading IT projects and stakeholder management.
- Experience implementing ETL/ELT process and Data pipelines.
- Experience with Snowflake.
- Strong SQL scripting experience.
- Background and experience with cloud data technologies and tools.
- Familiar with data tools and technologies like Spark, Hadoop, Apache beam, Dataproc or similar.
- BigQuery, Redshift, or other Data warehouse tools.
- Real-time pipelines with Kinesis or Kafka.
- Batch processing.
- Serverless processing.
Benefits
- Competitive salary package.
- Share plan.
- Company performance bonuses.
- Value-based recognition awards.
- Referral bonus.
Global Benefits
- Career coaching.
- Global career opportunities.
- Non-linear career paths.
- Internal development programmes for management and technical leadership.
- Complex projects.
- Rotations.
- Internal tech communities.
- Training.
- Certifications.
- Coaching.
- Online learning platforms subscriptions.
- Pass-it-on sessions.
- Workshops.
- Conferences.
-
Data Engineering Expert
hace 4 semanas
Bogotá, Bogotá D.E., Colombia Scotiabank A tiempo completoJob SummaryWe are seeking a highly skilled Data Engineer Associate to join our team at Scotiabank. This is a challenging role that requires strong technical skills and the ability to work collaboratively with cross-functional teams.About the RoleThe Data Engineer will be responsible for designing, implementing, and maintaining large-scale data pipelines and...
-
Cloud Data Optimization Expert
hace 15 horas
Bogotá, Bogotá D.E., Colombia Heinsohn Business Technology A tiempo completoAbout Heinsohn Business TechnologyWe are a leading technology company dedicated to delivering innovative solutions. At Heinsohn, we're seeking a skilled Cloud Data Optimization Expert to join our team.Job OverviewAs a Cloud Data Optimization Expert, you will play a critical role in optimizing our cloud infrastructure and data workflows. Your expertise will...
-
Data Engineer with Cloud Expertise
hace 3 días
Bogotá, Bogotá D.E., Colombia Slalom Consulting A tiempo completoWe are excited to launch in Colombia, expanding our presence in the region and enhancing job postings with English and Spanish by early 2025. Our team at Slalom Build co-creates custom software, data, and cloud products with clients who are ready to accelerate their digital transformation. We're passionate about technology, driven by its potential as we help...
-
Data Engineering Specialist
hace 1 semana
Bogotá, Bogotá D.E., Colombia Ingepsy A tiempo completoJob Title: Data Engineering SpecialistAbout IngepsyIngepsy is a forward-thinking organization dedicated to harnessing the power of data to drive innovation and growth. Our team of experts is passionate about designing and implementing cutting-edge solutions that meet the evolving needs of our clients.Salary Range: $120,000 - $180,000 per annum, depending on...
-
Data Solutions Architect for Cloud and AI
hace 4 semanas
Bogotá, Bogotá D.E., Colombia Softwareone Deutschland Gmbh A tiempo completoAre you a technical expert in cloud platforms and AI solutions? Do you have experience in providing guidance to sales teams and customers on complex data and AI projects?We are seeking an experienced Data Solutions Architect for Cloud and AI to join our team at Softwareone Deutschland Gmbh. As a Data Solutions Architect, you will play a crucial role in...
-
Scotiabank Data Engineering Professional
hace 4 semanas
Bogotá, Bogotá D.E., Colombia Scotiabank A tiempo completo**Company Overview:** Scotiabank is a leading financial institution committed to delivering exceptional banking services to its customers. Our team of dedicated professionals works tirelessly to ensure that our clients receive the best possible experience. Salary: $120,000 - $180,000 per year Job Description:We are seeking an experienced Data Engineer to...
-
Chief Data Engineering Lead
hace 1 día
Bogotá, Bogotá D.E., Colombia Scopeworker A tiempo completoAbout Scopeworker Business IntelligenceAt Scopeworker, we are revolutionizing the Procure-Execute-Pay lifecycle of complex supplier services through our innovative enterprise SaaS platform. Our mission is to automate this process and enable an 'Uber' style marketplace for enterprises, providing real-time business intelligence that is truly unique.About the...
-
Senior Data Engineering Specialist
hace 1 mes
Bogotá, Bogotá D.E., Colombia TelevisaUnivision A tiempo completoCompany OverviewTelevisaUnivision is the leading Spanish-language media company in the world, investing in its content, people, and properties across digital, streaming, social, audio, linear, and live events.We're growing our offerings, building on the launch of our successful streaming platform ViX, which requires a team of skilled data engineers to build...
-
Cloud Data Architect
hace 2 meses
Bogotá, Bogotá D.E., Colombia Endava Limited A tiempo completoAt Endava Limited, we're harnessing technology to drive meaningful change. Our data team has expertise across engineering, analysis, architecture, modeling, machine learning, artificial intelligence, and data science. This discipline is responsible for transforming raw data into actionable insights, building robust data infrastructures, and enabling...
-
Bogotá, Bogotá D.E., Colombia Scotiabank A tiempo completoJob Description:This role involves designing, developing, and implementing Extract, Transform, Load (ETL) solutions using various tools such as SSIS, DataStage, and PLSQL. The ideal candidate will have a strong understanding of data processes, including aggregating, cleansing, and enrichment, as well as experience with Cloud solutions like MS Azure...
-
Cloud Data Architect with AI Vision
hace 4 semanas
Bogotá, Bogotá D.E., Colombia Provectus It, Inc. A tiempo completoAbout ProvectusAt Provectus, we empower businesses to leverage the full potential of AI and ML to drive transformation. Our focus is on crafting innovative data and ML infrastructure solutions that unlock end-to-end AI transformations across industries such as Healthcare & Life Sciences, Retail & CPG, Media & Entertainment, Manufacturing, and Internet...
-
Data Engineering Expert for Hybrid Environments
hace 2 días
Bogotá, Bogotá D.E., Colombia Slalom Consulting A tiempo completoWe are excited to launch our Data Engineering capability in Colombia, offering enhanced job postings with English and Spanish in early 2025. Our team is passionate about co-creating custom software, data, and cloud products with clients who want to accelerate their digital transformation.About Slalom BuildWho We AreSlalom Build is a highly scalable,...
-
Big Data Solutions Architect
hace 16 horas
Bogotá, Bogotá D.E., Colombia Talan A tiempo completoJob OverviewWe are seeking a highly skilled Big Data Solutions Architect to join our team at Talan. This role will play a key part in developing and implementing innovative big data solutions that drive business success.Key ResponsibilitiesDesign, develop, and implement end-to-end ETL processes with Spark/Scala, ensuring seamless data transfer and...
-
Cloud Data Solutions Architect
hace 3 días
Bogotá, Bogotá D.E., Colombia Buscojobs Colombia A tiempo completoRole OverviewWe are seeking a skilled Cloud Data Solutions Architect to join our team in Colombia. As a key member of our sales team, you will play a crucial role in collaborating with customers to understand their requirements and provide tailored solutions.About the RoleIn this full-time position, you will be responsible for providing technical support,...
-
Data Engineering Specialist
hace 2 semanas
Bogotá, Bogotá D.E., Colombia Endava Limited A tiempo completoCompany OverviewWe are a global company that harnesses technology to drive meaningful change. With over two decades of experience, we combine world-class engineering with industry expertise and a people-centric mindset to create innovative digital experiences.About the RoleAs a Senior Data Engineer at Endava Limited, you will be responsible for developing...
-
Chief Data Engineering Solutions Specialist
hace 1 mes
Bogotá, Bogotá D.E., Colombia Publicis Groupe A tiempo completoJob Title: Chief Data Engineering Solutions Specialist About Publicis Groupe:At Publicis Global Delivery, we are a continuously evolving machine of creation that aims to become a more efficient and collaborative system. We serve as a cross-media transformation agent, providing centralized expertise across Media, Production, Commerce, Content, Data &...
-
Data Engineering Specialist
hace 1 semana
Bogotá, Bogotá D.E., Colombia Within A tiempo completoAbout WITHIN: We are a leading Performance Branding company that drives business growth through innovative marketing strategies. Our integrated model combines creative and media, performance and brand, and across media channels to deliver exceptional results for our clients. With a full suite of offerings, we partner with iconic brands like The North Face,...
-
Senior Data Engineer
hace 2 semanas
Bogotá, Bogotá D.E., Colombia Endava Limited A tiempo completoCompany OverviewAt Endava, we harness technology to drive meaningful change. With a people-centric mindset and world-class engineering expertise, we consult and partner with leading brands to create dynamic platforms and intelligent digital experiences that drive innovation and transform businesses.Job DescriptionWe are seeking a highly skilled Senior Data...
-
Senior Data Engineer: Architecture and Innovation
hace 2 semanas
Bogotá, Bogotá D.E., Colombia Amadeus A tiempo completoJob OverviewWe are seeking an experienced Senior Data Engineer to join our team in Hospitality BI. This role will involve designing and implementing data pipelines to provide insights into market performance and traveler trends. You will work with a variety of data sources, including industry metrics and customer information.About the RoleThis is a...
-
Cloud Data Architect
hace 1 mes
Bogotá, Bogotá D.E., Colombia Medtronic A tiempo completoAre you passionate about data architecture and design? Do you enjoy working with cloud-based technologies like Snowflake, Informatica Cloud, Coalesce, DBT, Airflow, Oracle, and Python?We are seeking a talented Cloud Data Architect to join our team at Medtronic. As a key member of our data architecture team, you will be responsible for designing and building...