Senior Data Engineer

hace 3 semanas

Colombia Lean Solutions Group A tiempo completo

Company Overview

Lean Solutions Group is committed to enhancing business efficiency through innovative technology solutions. Our mission is to drive transformation by leveraging cutting-edge AI and machine learning techniques. We uphold a culture of continuous learning, collaboration, and customer-centricity, ensuring exceptional outcomes for our clients. Recognized for our expertise in deploying scalable solutions that seamlessly integrate with enterprise systems, we have established a strong foothold in the tech industry. With a global presence and a team of dedicated professionals, Lean Solutions Group is at the forefront of innovation, constantly pushing boundaries to meet the dynamic needs of businesses worldwide.

What You Will Be Doing

  1. Architect and implement autonomous GPT-based systems for real-time workflow automation.
  2. Fine-tune and optimize large language models for specific automation tasks.
  3. Automate end-to-end processes managing unstructured data and decision logic.
  4. Develop and maintain data pipelines using AWS services like Glue and Lambda.
  5. Ensure data integrity and efficient processing using tools like Pandas and PySpark.
  6. Design scalable solutions for seamless integration with enterprise cloud systems such as EC2 and RDS.
  7. Implement monitoring systems for deployed models and incorporate feedback mechanisms.
  8. Collaborate with cross-functional teams to gather requirements and deliver solutions aligned with business objectives.
  9. Stay informed on industry trends in AI and machine learning, integrating innovations into current systems.

Required Skills & Experience

  1. Bachelor's or Master's degree in Computer Science, Machine Learning, Data Engineering, or a related field.
  2. 5+ years of experience in data engineering and machine learning, particularly with NLP and process automation.
  3. Advanced proficiency in Python, including experience with data analysis using pandas and machine learning frameworks like PyTorch and TensorFlow.
  4. Intermediate experience with AWS services, such as RDS, EC2, Glue, and Lambda, for managing data solutions and scaling models.
  5. Deep understanding of LLMs with experience in fine-tuning and applying NLP techniques.
  6. Experience with API development and integration.
  7. Strong knowledge of MLOps practices, including model deployment, versioning, and monitoring.
  8. Familiarity with data engineering tools and frameworks such as Pandas and PySpark for efficient data processing.
  9. Excellent problem-solving skills and ability to work with cross-functional teams.
  10. Intermediate knowledge of Docker and familiarity with microservices architecture and containerization technologies.
  11. Understanding of prompt engineering and reinforcement learning from human feedback (RLHF) to enhance GPT-based systems.
  12. Experience with reinforcement learning from human feedback (RLHF) techniques.
  13. Familiarity with microservices architecture.
  14. Proficiency in utilizing pandas and PySpark for data analysis.
  15. Experience with process automation tools and frameworks.
  16. Knowledge of prompt engineering to enhance GPT-based systems.
  17. Understanding of the ethical considerations and safety measures in autonomous systems.
  18. Intermediate experience with Docker for containerization.
  19. Advanced problem-solving skills with innovative solution approaches.
  20. Effective Communication: Ability to clearly articulate complex technical concepts to non-technical stakeholders, facilitating cross-functional collaboration.
  21. Problem-Solving: Strong analytical and innovative skills, essential for navigating and resolving complex challenges in data engineering and process automation.
  22. Collaboration: Demonstrated experience working with diverse teams to gather requirements and deliver data-driven solutions aligned with business objectives.
  23. Adaptability: Proactively stay informed about industry trends in AI and machine learning, and integrate innovative solutions into current systems to maintain a competitive edge.
  24. Leadership: Lead projects with a focus on optimizing performance and efficiency, fostering a culture of continuous improvement and learning.

Why You Will Love Working with Us

  1. Join a powerful tech workforce and help us change the world through technology.
  2. Professional development opportunities with international customers.
  3. Collaborative work environment and career path and mentorship programs that will lead to new levels.

Join Lean Tech and contribute to shaping the data landscape within a dynamic and growing organization. Your skills will be honed, and your contributions will play a vital role in our continued success. Lean Tech is an equal-opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.

#J-18808-Ljbffr

  • Senior Data Engineer

    hace 6 meses

    Colombia Provectus IT, Inc. A tiempo completo

    **Senior Data Engineer**: Medellín, Antioquia, Bogotá, Capital District, San Jose **About project** We are seeking a talented and experienced** Senior Data Engineer** to join our team at Provectus. You will encounter numerous technical challenges and have the opportunity to contribute to exciting open-source projects (e.g., ODD, UI for Kafka), build...

  • Senior Data Engineer

    hace 6 meses

    Colombia Blankfactor A tiempo completo

    It's fun to work in a company where people truly BELIEVE in what they're doing! We're committed to bringing passion and customer focus to the business. About us At Blankfactor, we are dedicated to engineering impact. We are passionate about creating value by building best-in-class tech solutions for companies looking to transform, innovate, and scale....

  • Senior Azure Data Engineer

    hace 6 meses

    Colombia Adage Tech SAS A tiempo completo

    At Adage Tech SAS, we continue to grow and want you to be part of our future talents! We are looking for a **Senior Azure Data Engineer** in Colombia to create data pipelines, perform some database administration, and other Azure data related tasks. **Requirements**: - Advanced English Level (B2) - 5+ years of experience - Data engineering - SQL - ADF -...

  • Senior Data Engineer

    hace 1 mes

    Colombia Monokera A tiempo completo

    ¡En Monokera buscamos un Senior Data Engineer apasionado y con visión estratégica! Serás una pieza clave en el diseño, implementación y mejora de soluciones analíticas basadas en Big Data. Compartirás con un equipo talentoso, promoverás las mejores prácticas en la arquitectura de datos y colaborarás con otros equipos en proyectos de alto...

  • Senior Data Engineer

    hace 15 horas

    Colombia Lean Solutions Group A tiempo completo

    Company Overview: Lean Tech is a rapidly expanding organization situated in Medellín, Colombia. We pride ourselves on possessing one of the most influential networks within software development and IT services for the entertainment, financial, and logistics sectors. Our corporate projections offer many opportunities for professionals to elevate their...

  • Senior Cloud Data Engineer with GCP Expertise

    hace 1 mes

    Colombia NEORIS A tiempo completo

    NEORIS, a Digital accelerator with 20 years of experience as Digital Partners of large companies, is seeking a Senior Cloud Data Engineer with GCP Expertise.About the Role:We are looking for a highly skilled Cloud Data Engineer to join our team. The successful candidate will have expertise in GCP, SQL, and Python, with a strong focus on data extraction,...

  • Senior Data Engineer

    hace 6 meses

    Colombia, Huila Cooperative Computing A tiempo completo

    **Cooperative Computing (CC):  We accelerate growth minded companies into the automated economy**. The business market is in rapid change, with consumer behavior placing significantly high expectations on businesses at every phase in the client experience.  Each day, we experience a company dramatically shifting “industry norms” and in many cases,...

  • Senior Data Engineer

    hace 4 semanas

    Colombia Lean Tech A tiempo completo

    Company Overview Lean Tech is a rapidly expanding organization situated in Medellín, Colombia. We pride ourselves on possessing one of the most influential networks within software development and IT services for the entertainment, financial, and logistics sectors. Our corporate projections offer a multitude of opportunities for professionals to elevate...

  • Senior Data Engineer

    hace 2 meses

    Colombia PayJoy Inc. A tiempo completo

    About PayJoy PayJoy is a mission-first financial service provider dedicated to helping under-served customers in emerging markets to achieve financial stability and success. We lend through our patented technology that turns a smartphone into digital collateral, and our cutting-edge machine learning, data science, and anti-fraud AI allow us to offer the...

  • Senior Data Engineer

    hace 1 mes

    Colombia Dentsu Aegis Network Ltd. A tiempo completo

    Company OverviewDentsu Aegis Network Ltd. is a global media and digital marketing agency that provides innovative solutions to help businesses succeed in today's fast-paced digital landscape.SalaryThe estimated base salary range for this position is $146,250 - $245,750 based on the location of Columbia.Job DescriptionWe are seeking an experienced Senior Data...

  • Senior Data Engineer

    hace 4 semanas

    Colombia WIZELINE A tiempo completo

    About the RoleWe are seeking a Senior Data Engineer to join our team in Colombia. As a key member of our engineering team, you will be responsible for designing and implementing high-performance data systems that meet the needs of our business.With a strong background in data engineering and a passion for innovation, you will work closely with our product...

  • Cloud Data Engineer

    hace 2 meses

    Colombia Mechanized AI A tiempo completo

    Job Title: Cloud Data EngineerJob Summary:We are seeking a skilled Cloud Data Engineer to join our team at Mechanized AI. As a Cloud Data Engineer, you will be responsible for designing and building cloud architectures for data-centric products end-to-end. You will work with our team to create AI products in different clouds (Azure, GCP, AWS) and leverage...

  • Senior Data Engineer

    hace 2 semanas

    Colombia Findjobit A tiempo completo

    Job OverviewWe are seeking a highly skilled Senior Data Engineer to join our team at Advancio. The successful candidate will be responsible for designing and implementing data solutions using SQL scripting and the Azure ETL stack.Key ResponsibilitiesDesign, develop, and maintain large-scale data processing systems using Azure Data Factory, Blob Storage, and...

  • Senior Data Warehouse Engineer

    hace 1 mes

    Colombia Binance A tiempo completo

    Binance seeks a highly skilled Data Warehouse Engineer to design and develop a universal and flexible data warehouse system. The ideal candidate will have a deep understanding of data warehouse modeling and data governance, as well as experience with OLAP technologies and Big Data components.The successful candidate will work closely with the data team to...

  • Senior Data Engineer

    hace 6 meses

    Colombia Blankfactor A tiempo completo

    It's fun to work in a company where people truly BELIEVE in what they're doing! We're committed to bringing passion and customer focus to the business. What we do At Blankfactor, we are dedicated to engineering impact. We are passionate about creating value by building best-in-class tech solutions for companies looking to transform, innovate, and scale....

  • Senior Data Engineer for Cloud Architecture

    hace 1 mes

    Colombia Lean Solutions Group A tiempo completo

    Company OverviewLean Solutions Group is a rapidly expanding organization situated in LATAM, offering a multitude of opportunities for professionals to elevate their careers and experience substantial growth.Position TitleSenior Backend EngineerLocationLATAMJob DescriptionWe are seeking a Senior Data Engineer for Cloud Architecture to help set the direction...

  • Senior Data Engineer

    hace 6 meses

    Colombia Blankfactor A tiempo completo

    It's fun to work in a company where people truly BELIEVE in what they're doing! We're committed to bringing passion and customer focus to the business. About us At Blankfactor, we are dedicated to engineering impact. We are passionate about creating value by building best-in-class tech solutions for companies looking to transform, innovate, and scale. In...

  • Data Engineer

    hace 6 meses

    Colombia ttg Talent Solutions A tiempo completo

    **JOB TITLE**:Data Engineer **LOCATION**:Medellín - Colombia **TYPE**:Full-Time **SCHEDULE**:Hybrid (3 days on-site / 2 days remote per week) **DESCRIPTION**:The Data Engineer III will be responsible for the design, development, and maintenance of our data infrastructure, with a strong emphasis on SQL development for automation and detailed analysis,...

  • Senior Data Engineer with Azure Expertise

    hace 4 semanas

    Colombia FindJobIT A tiempo completo

    Job OpportunityWe are seeking a highly skilled Senior Data Engineer to join our team at Advancio. As a key member of our engineering team, you will be responsible for designing, developing, and implementing data solutions using the Azure ETL stack.About the RoleThis is an exciting opportunity to work on complex data projects, leveraging your expertise in SQL...

  • Senior Data Systems Engineer

    hace 1 mes

    Colombia WIZELINE A tiempo completo

    Staff Data Engineer (Spark and Databricks Advanced)Wizeline, a global digital services company, seeks a Staff Data Engineer to join its team. As a key contributor, you will help build and scale high-quality digital products and services for mid-size to Fortune 500 companies.To succeed in this role, you must have:More than 10 years of experience in...