Lead Data Engineer

hace 2 meses

Medellín Antioquia, Colombia Kualty A tiempo completo

**What were looking for Lead Data Engineer**

We're looking for a seasoned **Lead Data Engineer** with 4-6 Years of work experience in data management disciplines including data integration, modeling, optimization and data quality, and/or other areas directly relevant to data engineering responsibilities and tasks required

**Responsabilities**:

- Design, create and maintain data pipelines will be the primary responsibility of the data engineer.
- Drive automation through effective metadata management.
- Assist with renovating the data management infrastructure to drive automation in data integration and management.
- Utilize modern data preparation, integration and AI-enabled metadata management tools and techniques.
- Track data consumption patterns.
- Perform intelligent sampling and caching.
- Monitor schema changes.
- Recommend and automate integration flows.

**SENIOR LEVEL RESPONSIBILITIES**
- Work with data science teams and with business (data) analysts to refine their data requirements for various data and analytics initiatives.
- Propose appropriate (and innovative) data ingestion, preparation, integration and operationalization techniques.
- Train counterparts such as data scientists, data analysts, LOB users or any data consumers in data pipelining and preparation techniques.
- Ensure that data users and consumers use the data provisioned to them responsibly through data governance and compliance initiatives. Participate in vetting and promoting content created in the business and by data scientists to the curated data catalog for governed reuse.
- Become a data and analytics evangelist by promoting the available data and analytics capabilities and expertise to business unit leaders and educating them in leveraging these capabilities in achieving their business goals.
- Define coding standards, including Object Oriented design standards and design patterns
- Implement a standardized library of reusable objects across the enterprise. This would include reusable libraries to integrate with the major source systems, such as the core banking platform, for example.
- Lead the assessment and implementation of advanced integration patterns, such as real-time streaming and real-time API integrations as an example

**Experience and knowledge**
- 4-6 Years of work experience in data management disciplines including data integration, modeling, optimization and data quality, and/or other areas directly relevant to data engineering responsibilities and tasks required
- At least 3 years of experience working in cross-functional teams and collaborating with business stakeholders in the banking business domain, in support of a departmental and/or multi-departmental data management and analytics initiative required
- Strong experience with advanced analytics tools for object-oriented/object function scripting using languages such as **R, Python, Java**, and **Scala** required
- Strong experience with popular database programming languages including **SQL** and **PL/SQL** for relational databases and certifications on upcoming **NoSQL/Hadoop** oriented databases like **MongoDB **and **Cassandra** for nonrelational databases required
- Strong experience in working with large, heterogeneous datasets in building and optimizing **data pipelines**, **pipeline architectures** and integrated datasets using traditional data integration technologies These should include **ETL/ELT**, data **replication/CDC**, message-oriented data movement, API design and access and upcoming data ingestion and integration technologies such as stream data integration, CEP and data virtualization required
- Strong experience in working with SQL on Hadoop tools and technologies including **HIVE, Impala,** Presto and others from an open source perspective and **Hortonworks Data Flow (HDF), Dremio, Informatica**, Talend among others from a commercial vendor perspective required
- Strong experience in working with and optimizing existing ETL processes and data integration and data preparation flows and helping to move them in production required
- Strong experience in working with both open-source and commercial message queuing technologies **(Kafka, JMS, Azure Service Bus, Amazon Simple queuing Service),** stream data integration technologies such as** Apache Nifi, Apache Beam, Apache Kafka Streams, Amazon Kinesis, **others and stream analytics technologies **(Apache Kafka, KSQL, Apache Spark) required**:

- Basic experience working with popular data discovery, analytics and BI software tools like **Tableau,** and **OBI** for semantic-layer-based data discovery required
- Strong experience in working with data science teams in refining and optimizing data science and machine learning models and algorithms required
- Basic experience in working with data governance teams and specifically business data stewards and the CISO in moving data pipelines into production with appropriate data quality, governance and security standards and certificatio

  • Data Engineer Lead

    hace 2 semanas

    Medellín, Antioquia, Colombia Amwell A tiempo completo

    Job SummaryAmwell is seeking a highly skilled Data Engineer Lead to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data systems and pipelines to support our business needs. About the RoleWe are looking for a talented data engineer with experience in cloud-based data...

  • Lead Data Visualization Specialist

    hace 4 semanas

    Medellín, Antioquia, Colombia Epam A tiempo completo

    Lead Tableau EngineerWe are seeking a highly skilled Lead Tableau Engineer to drive our data visualization strategy forward.In this role, you will collaborate closely with our back-end development team to design and implement data structures, transformations, and calculations that bring our data to life.You will be responsible for developing and maintaining...

  • Lead Data Visualization Specialist

    hace 1 mes

    Medellín, Antioquia, Colombia Epam A tiempo completo

    About the RoleWe are seeking a skilled Lead Tableau Engineer to drive data storytelling and dashboard design excellence. As a key member of our team, you will collaborate with back-end developers to design and implement data structures, transformations, and calculations that unlock business insights.Key ResponsibilitiesDevelop and maintain data...

  • Data Cloud Engineer

    hace 2 meses

    Medellín, Antioquia, Colombia Mindtech A tiempo completo

    **Data Cloud Engineer** Mindtech is your gateway to exciting and impactful tech projects. We specialize in end-to-end software outsourcing, linking Latin American talent with global opportunities. Our fast, cost-effective approach ensures that our clients receive exceptional service and innovative solutions. With a diverse team of over 70 skilled...

  • Lead Data Engineer

    hace 2 meses

    Medellín, Antioquia, Colombia Amwell A tiempo completo

    **Company Description** Amwell digitally empowers payers, providers and innovators, enabling an ecosystem of care that spans across in-person, virtual and automated care. Amwell provides a leading hybrid care enablement platform in the United States and globally, connecting and enabling providers, payers, patients, and innovators to deliver greater access...

  • Data Engineer

    hace 2 semanas

    Medellín, Antioquia, Colombia BairesDev A tiempo completo

    Unlock Your Potential as a Data Engineer at BairesDevAt BairesDev, we're a global leader in technology projects, delivering cutting-edge solutions to top clients. Our diverse team of 4,000+ tech talent works remotely, driving significant impact worldwide.We're seeking a talented Data Engineer to join our Development team and contribute to various projects...

  • Senior Pipeline Engineer/team Lead

    hace 4 meses

    Antioquia, Colombia Ongresso A tiempo completo

    **Senior Pipeline Engineer/Team Lead** **USD $4,000 - $6,000 or more** English C1 + Work arrangement: Hybrid 3 days On-Site (Mon-Fri) Site Location: Complejo Ruta N Calle 67 52-20, Medellín, Antioquia Ongresso Technologies está buscando un Senior Pipeline Engineer/Team Lead para que sea responsable de garantizar la confiabilidad de los pipelines de...

  • Lead Data Visualization Specialist

    hace 1 mes

    Medellín, Antioquia, Colombia Epam A tiempo completo

    About the RoleWe are seeking a skilled Lead Tableau Engineer to drive data storytelling and dashboard design excellence. In this role, you will collaborate with back-end developers to design and implement data structures, transformations, and calculations that unlock business insights.Key ResponsibilitiesDevelop and maintain data visualizations that inform...

  • Lead Data Visualization Specialist

    hace 2 semanas

    Medellín, Antioquia, Colombia Epam A tiempo completo

    About the RoleWe are seeking a skilled Lead Tableau Engineer to drive the development of our data visualization capabilities. In this role, you will collaborate with back-end developers to design and implement data structures, transformations, and calculations that enable effective data storytelling. Your expertise will be crucial in suggesting and...

  • Lead Data Engineer

    hace 2 semanas

    Medellín, Colombia Amwell A tiempo completo

    Company Description Amwell digitally empowers payers, providers and innovators, enabling an ecosystem of care that spans across in-person, virtual and automated care. Amwell provides a leading hybrid care enablement platform in the United States and globally, connecting and enabling providers, payers, patients, and innovators to deliver greater access...

  • Senior Data Engineer

    hace 2 meses

    Medellín, Antioquia, Colombia N-iX A tiempo completo

    As a Data Engineer, you will play a crucial role in building and optimizing our data pipeline, which is central to our platform's reliability and performance. You will be responsible for architecting and maintaining efficient data streams and integrating the latest technologies, with a particular focus on complex event processing (CEP), to support our...

  • Senior Python Data Engineer

    hace 2 meses

    Medellín, Antioquia, Colombia N-iX A tiempo completo

    N-iX is looking for a Senior Python Data Engineer in Medellin. As a Data Engineer, you will dive into the heart of data infrastructure, crafting solutions that drive business forward. You will collaborate with a dynamic team to transform raw data into actionable insights. **Responsibilities**: - Design, develop, and maintain scalable data pipelines and...

  • Data Engineer

    hace 2 semanas

    Medellín, Antioquia, Colombia myGwork A tiempo completo

    ¡Únete a nuestro equipo de Data Engineer en Accenture!En Accenture, estamos buscando a un Data Engineer experimentado para unirse a nuestro equipo de tecnología en Medellín. Si eres un profesional apasionado por la tecnología y la innovación, y tienes más de 2 años de experiencia en el campo de la ingeniería de datos, ¡esta es tu oportunidad!¿Por...

  • Data Engineer

    hace 2 semanas

    Medellín, Antioquia, Colombia Neostella A tiempo completo

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Neostella. As a Data Engineer, you will play a crucial role in designing, implementing, and optimizing our data architecture on AWS.Key ResponsibilitiesDevelop and maintain complex SQL scripts and queries to extract, transform, and load data into AWS-based data warehouses.Design,...

  • Data Engineer

    hace 2 meses

    Medellín, Antioquia, Colombia Paystone A tiempo completo

    Welcome to the dynamic world of Business Intelligence! If you’re ready to embark on a thrilling journey of transforming raw data into valuable insights and driving informed decision-making, then you’ve come to the right place. We are seeking a talented and experienced **Data Engineer** to join our team. As a Data Engineer at Paystone, you will be...

  • Data Engineer

    hace 3 semanas

    Medellín, Antioquia, Colombia Neostella A tiempo completo

    About NeostellaWe are a customer-centric company that uses cutting-edge technologies to deliver innovative solutions to meet the unique needs of our clients' businesses. Our offerings include Neodeluxe Legal Solutions, Work-Relay process and workflow solutions for Salesforce, Robotic Process Automation, and Application Integration.Job DescriptionWe are...

  • Senior Data Engineer

    hace 2 meses

    Medellín, Antioquia, Colombia Endava A tiempo completo

    **Company Description** Technology is our how. And people are our why. For over two decades, we have been harnessing technology to drive meaningful change. By combining world-class engineering, industry expertise and a people-centric mindset, we consult and partner with leading brands from various industries to create dynamic platforms and intelligent...

  • Lead Software Development Engineer in Test

    hace 1 mes

    Medellín, Antioquia, Colombia Lean Tech A tiempo completo

    Company Overview: Lean Tech is a rapidly expanding organization situated in Medellín, Colombia. We pride ourselves on possessing one of the most influential networks within software development and IT services for the entertainment, financial, and logistics sectors. Our corporate projections offer a multitude of opportunities for professionals to elevate...

  • Data Engineer

    hace 2 meses

    Medellín, Antioquia, Colombia Amwell A tiempo completo

    **Company Description** Amwell digitally empowers payers, providers and innovators, enabling an ecosystem of care that spans across in-person, virtual and automated care. Amwell provides a leading hybrid care enablement platform in the United States and globally, connecting and enabling providers, payers, patients, and innovators to deliver greater access...

  • Data Engineer Leader

    hace 2 días

    Medellín, Antioquia, Colombia Rockwell Automation A tiempo completo

    At Rockwell Automation, we're looking for a talented Data Engineer Leader to join our team. As a key member of our organization, you will play a crucial role in supporting the stability of our platform by monitoring and responding to support tickets. You will also enable business capability teams to meet their objectives by sourcing new data.We're seeking a...