Lead Data Engineer

hace 1 semana

Medellín, Antioquia, Colombia Kualty A tiempo completo
Job Title: Lead Data Engineer

We are seeking a highly skilled Lead Data Engineer to join our team at Kualty. As a Lead Data Engineer, you will be responsible for designing, creating, and maintaining data pipelines, driving automation through effective metadata management, and assisting with renovating the data management infrastructure to drive automation in data integration and management.

Responsibilities:
  • Data Pipeline Development: Design, create, and maintain data pipelines to ensure efficient and accurate data processing.
  • Automation and Metadata Management: Drive automation through effective metadata management, ensuring data consistency and quality.
  • Data Infrastructure Renovation: Assist with renovating the data management infrastructure to drive automation in data integration and management.
  • Modern Data Tools and Techniques: Utilize modern data preparation, integration, and AI-enabled metadata management tools and techniques to improve data quality and efficiency.
  • Data Consumption Patterns: Track data consumption patterns to identify areas for improvement.
  • Intelligent Sampling and Caching: Perform intelligent sampling and caching to optimize data processing.
  • Schema Changes: Monitor schema changes to ensure data consistency.
  • Integration Flows: Recommend and automate integration flows to improve data quality and efficiency.
Senior Level Responsibilities:
  • Data Science Collaboration: Work with data science teams and business analysts to refine data requirements for various data and analytics initiatives.
  • Data Ingestion and Preparation: Propose appropriate data ingestion, preparation, integration, and operationalization techniques to improve data quality and efficiency.
  • Data Training and Education: Train counterparts in data pipelining and preparation techniques to ensure data consistency and quality.
  • Data Governance and Compliance: Ensure data users and consumers use data responsibly through data governance and compliance initiatives.
  • Data Evangelism: Promote available data and analytics capabilities and expertise to business unit leaders and educate them on leveraging these capabilities to achieve business goals.
  • Coding Standards: Define coding standards, including object-oriented design standards and design patterns.
  • Reusable Objects: Implement a standardized library of reusable objects across the enterprise.
  • Advanced Integration Patterns: Lead the assessment and implementation of advanced integration patterns, such as real-time streaming and real-time API integrations.
Requirements:
  • Experience: 4-6 years of work experience in data management disciplines, including data integration, modeling, optimization, and data quality.
  • Cross-Functional Teams: At least 3 years of experience working in cross-functional teams and collaborating with business stakeholders in the banking business domain.
  • Advanced Analytics Tools: Strong experience with advanced analytics tools for object-oriented/object function scripting using languages such as R, Python, Java, and Scala.
  • Database Programming Languages: Strong experience with popular database programming languages, including SQL and PL/SQL for relational databases and certifications on upcoming NoSQL/Hadoop-oriented databases like MongoDB and Cassandra for non-relational databases.
  • Large Datasets: Strong experience in working with large, heterogeneous datasets in building and optimizing data pipelines, pipeline architectures, and integrated datasets using traditional data integration technologies.
  • SQL on Hadoop Tools: Strong experience in working with SQL on Hadoop tools and technologies, including HIVE, Impala, Presto, and others from an open-source perspective and Hortonworks Data Flow (HDF), Dremio, Informatica, Talend among others from a commercial vendor perspective.
  • ETL Processes: Strong experience in working with and optimizing existing ETL processes and data integration and data preparation flows and helping to move them in production.
  • Message Queuing Technologies: Strong experience in working with both open-source and commercial message queuing technologies, including Kafka, JMS, Azure Service Bus, Amazon Simple queuing Service, stream data integration technologies, and stream analytics technologies.
  • Data Discovery and Analytics Tools: Basic experience working with popular data discovery, analytics, and BI software tools, including Tableau and OBI for semantic-layer-based data discovery.
  • Data Science Teams: Strong experience in working with data science teams in refining and optimizing data science and machine learning models and algorithms.
  • Data Governance Teams: Basic experience in working with data governance teams and specifically business data stewards and the CISO in moving data pipelines into production with appropriate data quality, governance, and security standards and certification.
  • Language: English level B2+.

Benefits:

  • 100% Remote Work: Work 100% remote.
  • Flexible Work Schedule: Work from anywhere.
  • US Dollar Salary: We pay in US dollars.
  • Short Fridays: Every Friday is short Friday.
  • Holidays: Enjoy all the holidays in your country.
  • Referral Bonus: Referral bonus paid every month.
  • Personal Computer Aid: Aid of 40 USD for personal computer use.
  • Full Access to Platzi: Full access to Platzi.
  • Surprises: Sending surprises at home.
  • Annual Trip: Annual trip to the beach.
  • PTO Payments: 10 days of PTO payments.

  • Lead Data Engineer

    hace 4 días

    Medellín, Antioquia, Colombia Kualty A tiempo completo

    Job Title: Lead Data EngineerWe are seeking a highly skilled Lead Data Engineer to join our team at Kualty. As a Lead Data Engineer, you will be responsible for designing, creating, and maintaining data pipelines, driving automation through effective metadata management, and assisting with renovating the data management infrastructure to drive automation in...

  • Lead Data Engineer

    hace 1 semana

    Medellín, Antioquia, Colombia Kualty A tiempo completo

    Job Title: Lead Data EngineerWe are seeking a highly skilled Lead Data Engineer to join our team at Kualty. As a key member of our data engineering team, you will be responsible for designing, creating, and maintaining data pipelines that drive business growth and innovation.Responsibilities:Design and implement data pipelines that meet business requirements...

  • Lead Data Engineer

    hace 3 días

    Medellín, Antioquia, Colombia Kualty A tiempo completo

    Job Title: Lead Data EngineerWe are seeking a highly skilled Lead Data Engineer to join our team at Kualty. As a seasoned professional with 4-6 years of experience in data management disciplines, you will be responsible for designing, creating, and maintaining data pipelines, driving automation through effective metadata management, and assisting with...

  • Lead Data Visualization Specialist

    hace 2 semanas

    Medellín, Antioquia, Colombia Epam A tiempo completo

    About the RoleWe are seeking a skilled Lead Tableau Engineer to drive data storytelling and dashboard design excellence. As a key member of our team, you will collaborate with back-end developers to design and implement data structures, transformations, and calculations that unlock business insights.Key ResponsibilitiesDevelop and maintain data...

  • Lead Data Engineer

    hace 6 días

    Medellín, Antioquia, Colombia Kualty A tiempo completo

    Job DescriptionWe are seeking a highly skilled Lead Data Engineer to join our team at Kualty. As a seasoned professional in data management disciplines, you will be responsible for designing, creating, and maintaining data pipelines, driving automation through effective metadata management, and assisting with renovating the data management infrastructure to...

  • Lead Data Engineer

    hace 3 semanas

    Medellín, Antioquia, Colombia Kualty A tiempo completo

    About the RoleWe are seeking a highly skilled Lead Data Engineer to join our team at Kualty. As a key member of our data engineering team, you will be responsible for designing, creating, and maintaining data pipelines, driving automation through effective metadata management, and assisting with renovating our data management infrastructure to drive...

  • Lead Data Engineer

    hace 3 semanas

    Medellín, Antioquia, Colombia Kualty A tiempo completo

    About the RoleWe are seeking a highly skilled Lead Data Engineer to join our team at Kualty. As a seasoned data management expert, you will be responsible for designing, creating, and maintaining data pipelines, driving automation through effective metadata management, and assisting with renovating the data management infrastructure to drive automation in...

  • Lead Data Visualization Specialist

    hace 2 semanas

    Medellín, Antioquia, Colombia Epam A tiempo completo

    About the RoleWe are seeking a skilled Lead Tableau Engineer to drive data storytelling and dashboard design excellence. In this role, you will collaborate with back-end developers to design and implement data structures, transformations, and calculations that unlock business insights.Key ResponsibilitiesDevelop and maintain data visualizations that inform...

  • Data Engineer

    hace 2 semanas

    Medellín, Antioquia, Colombia Neostella A tiempo completo

    {"title": "Data Engineer at Neostella", "description": "Job SummaryNeostella is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, implementing, and optimizing data models and database schemas for efficient data storage and retrieval on AWS.Key ResponsibilitiesDevelop and maintain complex SQL...

  • Lead Data Scientist

    hace 3 días

    Medellín, Antioquia, Colombia Aimpoint Digital A tiempo completo

    About Aimpoint DigitalAimpoint Digital is a premier analytics consulting firm that drives business value for clients through expertise in data strategy, data analytics, decision sciences, and data engineering and infrastructure.Job SummaryWe are seeking a highly skilled Lead Data Scientist to join our decision sciences practice. As a Lead Data Scientist, you...

  • Data Engineer Bilingual

    hace 1 semana

    Medellín, Antioquia, Colombia Personalsoft A tiempo completo

    Job DescriptionPersonalsoft is seeking a highly skilled Data Engineer Bilingual to join our team. As a key member of our data team, you will be responsible for designing, building, and maintaining large-scale data systems.Key ResponsibilitiesDesign and implement data pipelines using ETL tools such as Xplenty, Stitch, Informatica, Data Fusion, and...

  • Data Engineer

    hace 3 semanas

    Medellín, Antioquia, Colombia Neostella A tiempo completo

    About NeostellaWe are a customer-centric technology company that utilizes cutting-edge solutions to deliver tailored business outcomes for our clients. Our offerings include Neodeluxe Legal Solutions, Work-Relay process and workflow solutions for Salesforce, Robotic Process Automation, and Application Integration.Job SummaryWe are seeking a highly skilled...

  • Data Engineer Bilingual

    hace 3 semanas

    Medellín, Antioquia, Colombia Personalsoft A tiempo completo

    About the RoleWe are seeking a highly skilled Data Engineer Bilingual to join our team at Personalsoft. As a key member of our data team, you will be responsible for designing, building, and maintaining large-scale data systems and architectures.Key ResponsibilitiesDesign and implement data pipelines, architectures, and data sets to support business...

  • Lead Software Engineer

    hace 3 semanas

    Medellín, Antioquia, Colombia AgileEngine A tiempo completo

    About AgileEngineWe are a fast-growing company that creates custom software solutions for top-tier clients. Our team is passionate about delivering high-quality products that make a real impact.Job SummaryWe are seeking a highly skilled Lead Software Engineer to join our team. As a key member of our engineering team, you will be responsible for designing and...

  • Lead Data Scientist, Machine Learning Engineer, Colombia

    hace 2 semanas

    Medellín, Antioquia, Colombia Aimpoint Digital A tiempo completo

    About the RoleAimpoint Digital is a leading analytics consulting firm dedicated to driving business value for clients through expertise in data strategy, data analytics, decision sciences, and data engineering and infrastructure. We are seeking a highly skilled Lead Data Scientist to join our decision sciences practice, which focuses on delivering solutions...

  • Lead Data Scientist, Machine Learning Engineer, Colombia

    hace 2 semanas

    Medellín, Antioquia, Colombia Aimpoint Digital A tiempo completo

    About the RoleAimpoint Digital is a leading analytics consulting firm dedicated to driving business value for clients through expertise in data strategy, data analytics, decision sciences, and data engineering and infrastructure. We are seeking a highly skilled Lead Data Scientist to join our decision sciences practice, which focuses on delivering solutions...

  • Lead Data Scientist, Machine Learning Engineer, Colombia

    hace 1 semana

    Medellín, Antioquia, Colombia Aimpoint Digital A tiempo completo

    About Aimpoint DigitalAimpoint Digital is a leading analytics consulting firm dedicated to driving business value for clients through expertise in data strategy, data analytics, decision sciences, and data engineering and infrastructure.Job SummaryWe are seeking a highly skilled Lead Data Scientist to join our decision sciences practice in Colombia. As a key...

  • Senior Data Architect

    hace 3 semanas

    Medellín, Antioquia, Colombia Endava A tiempo completo

    About this roleWe are seeking a Senior Data Engineer to join our team at Endava, working closely with our ML Engineering team to drive innovation and excellence in data engineering.Key responsibilitiesSupport the development and deployment of data science methodologies, leveraging expertise in Snowflake UDF development and general data ETL work.Collaborate...

  • Lead Data Scientist, Machine Learning Engineer, Colombia

    hace 1 semana

    Medellín, Antioquia, Colombia Aimpoint Digital A tiempo completo

    About Aimpoint DigitalAimpoint Digital is a leading analytics consulting firm dedicated to driving business value for clients through expertise in data strategy, data analytics, decision sciences, and data engineering and infrastructure.Job SummaryWe are seeking a highly skilled Lead Data Scientist to join our decision sciences practice in Colombia. As a key...

  • Lead Data Scientist, Machine Learning Engineer, Colombia

    hace 7 días

    Medellín, Antioquia, Colombia Aimpoint Digital A tiempo completo

    About Aimpoint DigitalAimpoint Digital is a premier analytics consulting firm that drives business value for clients through expertise in data strategy, data analytics, decision sciences, and data engineering and infrastructure.Job SummaryWe are seeking a highly skilled Lead Data Scientist to join our decision sciences practice, focusing on delivering...