Senior Data Engineer with Apache Spark and Python Expertise
hace 2 meses
Job Title: Senior Data Engineer
At Endava, we are seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for developing and implementing data pipelines, collaborating with data architects, and ensuring data quality and integrity.
Responsibilities:
- Work closely with the Data Analyst/Data Scientist to understand evolving needs and define the data processing flow or interactive reports.
- Discuss with stakeholders from other teams to better understand how data flows are used within the existing environment.
- Propose solutions for cloud-based architecture and deployment flow.
- Design and build processes, data transformation, and metadata to meet business requirements and platform needs.
- Design and propose solutions for the Relational and Dimensional Model based on platform capabilities.
- Develop, maintain, test, and evaluate big data solutions.
- Focus on production status and data quality of the data environment.
- Pioneer initiatives around data quality, integrity, and security.
Requirements:
- +5 years of experience in Data Engineering.
- Proficiency in Apache Spark.
- Proficiency in Python.
- Some experience leading IT projects and stakeholder management.
- Experience implementing ETL/ELT process and Data pipelines.
- Experience with Snowflake.
- Strong SQL scripting experience.
- Background and experience with cloud data technologies and tools.
- Familiar with data tools and technologies like Spark, Hadoop, Apache Beam, Dataproc or similar.
- BigQuery, Redshift, or other Data warehouse tools.
- Real-time pipelines with Kinesis or Kafka.
- Batch processing.
- Serverless processing.
- Strong analytic skills related to working with structured and unstructured data sensibilities.
-
Data Engineer Expert Leader
hace 1 mes
Cali, Valle del Cauca, Colombia Endava A tiempo completoOverviewEndava is a leading technology company that empowers businesses to succeed in a rapidly changing world. As a Senior Data Engineer, you will be part of our data team, which has expertise across engineering, analysis, architecture, modeling, machine learning, artificial intelligence, and data science.Job DescriptionWe are seeking an experienced Senior...
-
Senior Full Stack Engineer
hace 1 día
Cali, Valle del Cauca, Colombia INGEPSY A tiempo completoAt INGEPSY, we're seeking a talented Senior Full Stack Engineer to join our team.About the RoleWe're looking for an experienced engineer with expertise in backend development to help us build robust systems and scalable APIs. As a senior member of our team, you'll be working on complex challenges and collaborating with other engineers to deliver high-quality...
-
Senior Data Architect
hace 7 días
Cali, Valle del Cauca, Colombia Endava A tiempo completo**About Us**At Endava, technology is our how and people are our why. With over two decades of experience in harnessing technology to drive meaningful change, we combine world-class engineering, industry expertise, and a people-centric mindset to partner with leading brands from various industries.Our Data TeamWe have expertise across engineering, analysis,...
-
Information Architect
hace 2 meses
Cali, Valle del Cauca, Colombia Endava Limited A tiempo completoAt Endava, we're innovators who harness technology to drive meaningful change. With expertise across engineering, analysis, architecture, and data science, our data team has a vital role in transforming raw data into actionable insights.As a Senior Data Engineer, you'll be responsible for developing and implementing data pipelines, collaborating with data...
-
Cali, Valle del Cauca, Colombia Gestión Asertiva A tiempo completoWe are seeking a Software Engineer with expertise in Java and Python to join our team at {company}.The ideal candidate will have strong programming skills and experience with full stack development.The key responsibilities of this role include designing, developing, and testing software applications using Java and Python.We offer a collaborative and dynamic...
-
Senior Software Engineer with Python Expertise
hace 2 meses
Cali, Valle del Cauca, Colombia RedGage A tiempo completoJob Requirements:• 3+ years of experience in software development• Expertise in Python programming language• Strong understanding of cloud computing and DevOpsResponsibilities:• Design and develop scalable cloud-based applications• Collaborate with cross-functional teams to ensure smooth project delivery• Troubleshoot and debug complex software...
-
Chief Data Architect
hace 7 días
Cali, Valle del Cauca, Colombia Endava A tiempo completo**Job Summary:**We are seeking a highly skilled Chief Data Architect to join our team at Endava. As a Senior Data Engineer, you will play a crucial role in developing and implementing data pipelines, collaborating with data architects, and ensuring data quality and integrity.**About Us:**Endava is a global company that harnesses technology to drive...
-
Data Engineer
hace 2 meses
Cali, Valle del Cauca, Colombia Endava A tiempo completoData EngineerWe are seeking a skilled and analytical Data Engineer to join our team. In this role, you will be responsible for designing, implementing, and maintaining robust data infrastructure to support our organization's data-driven decision-making processes.Key ResponsibilitiesDesign, develop, and maintain scalable data pipelines to extract, transform,...
-
Senior Data Engineering Specialist
hace 1 mes
Cali, Valle del Cauca, Colombia Endava A tiempo completoJob Title: Senior Data Engineering SpecialistAbout the Role:We are seeking a highly skilled Senior Data Engineer to join our team at Endava. This is an exceptional opportunity for a seasoned professional to lead data engineering initiatives and work closely with our ML Engineering team.Responsibilities:• Collaborate with Data Analysts/Data Scientists to...
-
Software Engineer with Proficiency in Python
hace 2 meses
Cali, Valle del Cauca, Colombia Healthatom A tiempo completoWe are seeking a highly skilled Software Engineer with proficiency in Python to join our team. The ideal candidate will have a strong background in computer science and experience with machine learning algorithms. Responsibilities include designing and implementing software solutions, collaborating with cross-functional teams, and participating in code...
-
Cali, Valle del Cauca, Colombia Endava Limited A tiempo completoJob DescriptionWe are seeking an experienced Data Engineer to join our team in Colombia. In this role, you will be responsible for designing and implementing robust data infrastructure to support our organization's data-driven decision-making processes.
-
Cali, Valle del Cauca, Colombia NielsenIQ A tiempo completoAbout NielsenIQ">Label Insight is part of the Brandbank division of NielsenIQ and plays a vital role in digitizing, enhancing, and distributing data to clients and the wider NielsenIQ business.">We work with open data ecosystems in the cloud. Our clients around the world rely on NielsenIQ's data and insights to innovate and grow.">Job Overview">As a Software...
-
Senior Java Developer with Security Expertise
hace 4 semanas
Cali, Valle del Cauca, Colombia Ingepsy A tiempo completoJob DescriptionThis is a remote position and we are hiring candidates from across the country. As one of the fastest-growing companies in the US, we create award-winning custom software solutions that help companies change the lives of millions.Your RoleWe are seeking a skilled Senior Java Developer with expertise in security to join our team. In this role,...
-
Senior DevOps Engineer
hace 3 días
Cali, Valle del Cauca, Colombia INGEPSY A tiempo completoWe are seeking a seasoned DevOps Engineer to join our team at INGEPSY. As a key member of our infrastructure group, you will play a vital role in ensuring the reliability, scalability, and performance of our cloud-based systems.In this position, you will be responsible for designing, implementing, and maintaining our CI/CD pipelines, as well as collaborating...
-
Data Analytics Engineer
hace 1 mes
Cali, Valle del Cauca, Colombia Colgate-Palmolive A tiempo completoColgate-Palmolive is seeking a skilled Data Analytics Engineer to join our dynamic team in Cali, Colombia.Job Description:We are looking for a professional with strong data analytics skills to continue our company's digital transformation journey. This role involves implementing global and local digital and analytics solutions using various tools such as...
-
Senior WordPress Developer with UX/UI Expertise
hace 4 semanas
Cali, Valle del Cauca, Colombia Blossom Strategies A tiempo completoAbout Blossom Strategies: At Blossom Strategies, we prioritize collaboration and continuous growth in our approach to digital marketing and human capital management. We believe that adapting to clients' needs is key to success. With a diverse network of partners and a focus on scalable, customized solutions, we help senior living communities stay competitive...
-
Senior Java Developer for Data-Driven Projects
hace 4 semanas
Cali, Valle del Cauca, Colombia Agileengine A tiempo completoAre you a seasoned developer looking to expand your skills in data-driven projects? We are seeking a skilled Senior Java Developer to join our team at AgileEngine, one of the Inc. 5000 fastest-growing companies in the US and a top-3 ranked dev shop according to Clutch. With our award-winning custom software solutions, we have helped companies across 15+...
-
Senior Data Architect
hace 2 meses
Cali, Valle del Cauca, Colombia Endava Limited A tiempo completoData Transformation ExpertiseAt Endava, our data team harnesses world-class engineering and industry expertise to drive meaningful change. By combining cutting-edge data solutions with a people-centric mindset, we partner with leading brands to create innovative platforms and digital experiences.Key Responsibilities:Lead the development of robust data...
-
Senior Software Engineer
hace 4 semanas
Cali, Valle del Cauca, Colombia INGEPSY A tiempo completoExpert in Fullstack DevelopmentWe are looking for a skilled Senior Software Engineer - Fullstack Expert to join our team at AgileEngine, one of the Inc. 5000 fastest-growing companies in the US and a top-3 ranked dev shop according to Clutch.About AgileEngine:We create award-winning custom software solutions that help companies across 15+ industries change...
-
Software Engineer with Node.js Expertise
hace 7 días
Cali, Valle del Cauca, Colombia Ingepsy A tiempo completoJob DescriptionWe are looking for a skilled Software Engineer to join our team at Ingepsy in Cali, VAC. As a key member of our AgileEngine team, you will design and implement complex features using Node.js, TypeScript, GraphQL, and React.Responsibilities:Design and implement complex features and functionalities using Node.js, TypeScript, GraphQL, and...