Python Data Engineer
hace 3 semanas
AgileEngine is one of the Inc. 5000 fastest-growing companies in the U and a top-3 ranked dev shop according to Clutch. We create award-winning custom software solutions that help companies across 15+ industries change the lives of millions.
If you like a challenging environment where you're working with the best and are encouraged to learn and experiment every day, there's no better place - guaranteed :)
What you will do- Design, develop, and maintain ETL pipelines to extract, transform, and load data across various data sources (cloud storage, databases, APIs).
- Use Apache Airflow for orchestrating workflows, scheduling tasks, and managing pipeline dependencies.
- Build and manage data pipelines on Azure and GCP clouds.
- Design and support Data Lake.
- Write Python scripts for data cleansing, transformation, and enrichment using libraries like Pandas, PySpark.
- Analyze logs and metrics from Airflow and cloud services to resolve pipeline failures or inefficiencies.
- Experience (2+ years) writing efficient and scalable Python code, especially for data manipulation and ETL tasks (using libraries like Pandas, PySpark, Dask, etc.).
- Knowledge of Apache Airflow for orchestrating ETL workflows, managing task dependencies, scheduling, and error handling.
- Experience in building, optimizing, and maintaining ETL pipelines for large datasets, focusing on data extraction, transformation, and loading.
- Familiarity with cloud-native storage solutions.
- Understanding and working experience with different file formats.
- Expertise in writing efficient SQL queries for data extraction, transformation, and analysis.
- Familiarity with complex SQL operations (joins, aggregations, window functions, etc.).
- Familiarity with IAM (Identity and Access Management), data encryption, and securing cloud resources and data storage on both Azure and GCP.
- Use some Java libraries to request data from APIs.
- Knowledge of data governance practices, and the implementation of data lineage and metadata management in cloud environments.
- Professional growth: Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps.
- Competitive compensation: We match your ever-growing skills, talent, and contributions with competitive USD-based compensation and budgets for education, fitness, and team activities.
- A selection of exciting projects: Join projects with modern solutions development and top-tier clients that include Fortune 500 enterprises and leading product brands.
- Flextime: Tailor your schedule for an optimal work-life balance, by having the options of working from home and going to the office – whatever makes you the happiest and most productive.
The next steps of your journey will be shared via email within a few hours. Please check your inbox regularly and watch for updates from our Internal Applicant site, LaunchPod, which will guide you through the process.
#J-18808-Ljbffr-
Data Engineer Junior
hace 6 días
Medellín, Antioquia, Colombia Iris Neofinanciera A tiempo completoData Engineer Junior Palabras clave: Data Engineer SQL Server pyspark Glue studio Athena servicios en la nube Únete a Iris, la Neofinanciera de los empresarios, y sé parte de nuestra transformación digital.Buscamos un Data Engineer Junior apasionado por los datos y el desarrollo tecnológico.Ofrecemos un entorno de trabajo colaborativo con magníficos...
-
Data Engineer
hace 3 semanas
Medellín, Antioquia, Colombia Neostella A tiempo completoAt Neostella, we take a customer-centric approach anduse cutting-edge technologies to deliver solutions to meet theunique needs of our clients' business. Our offerings includeNeodeluxe Legal Solutions, Work-Relay process and workflowsolutions for Salesforce, Robotic Process Automation, andApplication Integration. In order to continue our growth, we...
-
Data Engineer
hace 2 semanas
Medellín, Antioquia, Colombia Neostella A tiempo completoAt Neostella, we take a customer-centric approach and use cutting-edge technologies to deliver solutions to meet the unique needs of our clients' business.Our offerings include Neodeluxe Legal Solutions, Work-Relay process and workflow solutions for Salesforce, Robotic Process Automation, and Application Integration.In order to continue our growth, we are...
-
Data Engineer Python
hace 2 semanas
Medellín, Antioquia, Colombia JobFinder Spain A tiempo completoWe are seeking a talented Senior Python Data Engineer to join our agile team at AgileEngine.Job OverviewAs a key member of our data engineering team, you will be responsible for designing and implementing data workflows using Airflow, Python, and Spark. You will analyze performance trends to proactively prevent problems and troubleshoot ETL issues to...
-
Mid+ Data Engineer
hace 2 semanas
Medellín, Antioquia, Colombia Leanstaffing A tiempo completoCompany Overview: Lean Tech is a rapidly expanding organization situated in Medellín, Colombia. We pride ourselves on possessing one of the most influential networks within software development and IT services for the entertainment, financial, and logistics sectors. Our corporate projections offer a multitude of opportunities for professionals to elevate...
-
Mid+ Data Engineer
hace 23 horas
Medellín, Antioquia, Colombia Leanstaffing A tiempo completoCompany Overview: Lean Tech is a rapidly expanding organization situated in Medellín, Colombia. We pride ourselves on possessing one of the most influential networks within software development and IT services for the entertainment, financial, and logistics sectors. Our corporate projections offer a multitude of opportunities for professionals to...
-
Cloud Data Architect
hace 7 días
Medellín, Antioquia, Colombia Leanstaffing A tiempo completoAbout the RoleThis is an exciting opportunity to join Leanstaffing's dynamic Data & Analytics team as a skilled data engineer. The role involves working on developing and optimizing ETL pipelines, leveraging Databricks, Python, SQL, and collaborating with cross-functional teams.Main ResponsibilitiesDevelop and optimize ETL pipelines using...
-
Data Solutions Engineer
hace 7 días
Medellín, Antioquia, Colombia Leanstaffing A tiempo completoCompany OverviewLeanstaffing is a rapidly expanding organization specializing in software development and IT services for various sectors. We pride ourselves on having one of the most influential networks within software development and IT services.Job DescriptionWe are seeking a talented data engineer to join our dynamic Data & Analytics team. This role...
-
Data Engineer
hace 4 semanas
Medellín, Antioquia, Colombia Kiwibot A tiempo completoAs a Data Engineer at Nickelytics, you will be an integral part of a fast-paced adtech startup.You will serve as the primary technical expert, responsible for leading and contributing to data projects from inception to completion.This role is critical in designing, developing, and maintaining data architectures, ETL processes, and pipelines, often leveraging...
-
Data Engineer Specialist
hace 2 semanas
Medellín, Antioquia, Colombia Neostella A tiempo completoAt Neostella, we're committed to delivering cutting-edge data solutions that meet the unique needs of our clients' businesses. Our team leverages advanced technologies and a customer-centric approach to drive growth and innovation.We're seeking an experienced Data Engineer who can help us achieve our goals. As a key member of our team, you'll work in a...
-
Big Data Transformation Expert
hace 7 días
Medellín, Antioquia, Colombia Leanstaffing A tiempo completoPosition SummaryWe are seeking a talented data engineer to join our dynamic Data & Analytics team at Leanstaffing. The role involves working on developing and optimizing ETL pipelines, leveraging Databricks, Python, SQL, and collaborating with cross-functional teams.Main ResponsibilitiesDevelop scalable data solutions to support business...
-
Data Engineer
hace 23 horas
Medellín, Antioquia, Colombia Softgic A tiempo completoData Engineer – KPI Management and Reporting Medellin, Colombia | Posted on 02/07/2025 We are seeking a top candidate to join our team as Data Engineer – KPI Management and Reporting . Compensation : COP 10M - 13M/month. Location : Medellin, Colombia Mission of Softgic: In Softgic S.A.S. we work for the digital and cognitive...
-
Data Engineer Specialist
hace 1 semana
Medellín, Antioquia, Colombia Neostella A tiempo completoJob Description">We are seeking an experienced Data Engineer to join our team at Neostella. As a key member of our data engineering group, you will be responsible for designing, implementing, and optimizing complex data models and database schemas for efficient data storage and retrieval on AWS.Key Responsibilities:Develop and maintain complex SQL scripts...
-
Data Engineer
hace 3 semanas
Medellín, Antioquia, Colombia Kualty A tiempo completoWhat were looking for Data Engineer (Only Latin America) Responsabilities: Utilize Power BI, Power Query and the Power BI Service for customer and internal reporting.Construct Data Models, Views and Stored Procedures with Microsoft SQL Server tools.Extract, Transform and Load transactional data to the data warehouse provide a uniform and consistent view of...
-
Data Architect and Engineer for Cloud Solutions
hace 1 semana
Medellín, Antioquia, Colombia JobFinder Spain A tiempo completoA strong Data Engineer at JobFinder Spain will have extensive knowledge of Python programming language, especially for data manipulation and ETL tasks using libraries like Pandas, PySpark.The successful candidate will be able to build and support complex SQL queries for data extraction, transformation, and analysis.Key Requirements2+ years of experience...
-
Mid Level Data Solutions Architect
hace 9 horas
Medellín, Antioquia, Colombia Leanstaffing A tiempo completoData Engineering Job Description:As a Mid+ Data Engineer, you will work on developing and optimizing ETL pipelines, managing the data lifecycle, and implementing data processing logic using SQL and Python. You will also collaborate with stakeholders to design scalable data solutions and support advanced analytics and machine learning...
-
Senior Data Engineer
hace 1 semana
Medellín, Antioquia, Colombia Lean Solutions Group A tiempo completoCompany Overview: Lean Tech is a rapidly expanding organization situated in Medellín, Colombia. We pride ourselves on possessing one of the most influential networks within software development and IT services for the entertainment, financial, and logistics sectors. Our corporate projections offer many opportunities for professionals to elevate their...
-
Data Engineering Lead
hace 1 semana
Medellín, Antioquia, Colombia Lean Solutions Group A tiempo completoAbout the Role:We are looking for a highly skilled and experienced Senior Data Engineer to join our team. As a key member of our data engineering team, you will play a pivotal role in developing and implementing AI-enabled solutions that seamlessly integrate into business processes using tools such as Python and Snowflake.Key Requirements:Advanced...
-
Big Data Engineer
hace 6 días
Medellín, Antioquia, Colombia Engineeringuk A tiempo completoJob DescriptionWe are seeking a skilled Data Engineer to join our team at dunnhumby, where you will be responsible for designing and developing big data back-ends for highly performant Business Intelligence applications. Your primary focus will be on executing big data projects, creating ready-to-use science products or software modules that deliver...
-
Data Engineer Specialist
hace 7 días
Medellín, Antioquia, Colombia CI&T A tiempo completoAt CI&T, we're dedicated to harnessing the power of data to drive innovation and growth.About the RoleWe're seeking a skilled Data Engineer to design, develop, and maintain scalable data solutions for our global clients.You'll collaborate with cross-functional teams to ensure data integrity and usability.Key Responsibilities:Data Pipeline Design and...