Enterprise Data Architect with Python Expertise

hace 2 semanas


Medellín, Antioquia, Colombia Endava A tiempo completo

At Endava, we are harnessing technology to drive meaningful change. By combining world-class engineering, industry expertise, and a people-centric mindset, we consult and partner with leading brands to create dynamic platforms and intelligent digital experiences.

Data Engineer Job Description

Our data team has expertise across engineering, analysis, architecture, modeling, machine learning, artificial intelligence, and data science. This discipline is responsible for transforming raw data into actionable insights and enabling data-driven decision-making and innovation through advanced analytics and predictive modeling.

As a Senior Data Engineer at Endava, you will be responsible for developing and implementing data pipelines, collaborating with data architects, and ensuring data quality and integrity. You will also support data migration projects and contribute to agile development processes.

  • Collaborate with the Data Analyst/Data Scientist to understand evolving needs and define the data processing flow or interactive reports.
  • Discuss with stakeholders from other teams to better understand how data flows are used within the existing environment.
  • Propose solutions for cloud-based architecture and deployment flow.
  • Design and build processes, data transformation, and metadata to meet business requirements and platform needs.
  • Design and propose solutions for the Relational and Dimensional Model based on platform capabilities.
  • Develop, maintain, test, and evaluate big data solutions.
  • Focus on production status and data quality of the data environment.
  • Pioneer initiatives around data quality, integrity, and security.

Requirements

  • +5 years of experience in Data Engineering.
  • Proficiency in Apache Spark.
  • Proficiency in Python.
  • Some experience leading IT projects and stakeholder management.
  • Experience implementing ETL/ELT process and Data pipelines.
  • Experience with Snowflake.
  • Strong SQL scripting experience.
  • Background and experience with cloud data technologies and tools.
  • Familiar with data tools and technologies like Spark, Hadoop, Apache Beam, Dataproc or similar.
  • BigQuery, Redshift, or other Data warehouse tools.
  • Real-time pipelines with Kinesis or Kafka.
  • Batch processing.
  • Serverless processing.
  • Strong analytic skills related to working with structured and unstructured data sensibilities.


  • Medellín, Antioquia, Colombia Oowlish A tiempo completo

    Company OverviewOowlish, a leading software development company in Latin America, is expanding its team of experienced technology professionals. Our commitment to innovation and excellence has earned us recognition as a Great Place to Work, providing a nurturing environment for growth and professional development.Job DescriptionWe are seeking a highly...

  • Cloud Data Architect

    hace 4 días


    Medellín, Antioquia, Colombia Neostella A tiempo completo

    At Neostella, a customer-centric company that leverages cutting-edge technologies to deliver innovative solutions for clients, we are seeking an experienced Cloud Data Architect. With a fast-paced startup environment and a rapidly growing business, our ideal candidate will possess expertise in data warehousing, migrations, and large datasets.About the RoleWe...

  • Data Architect Position

    hace 3 semanas


    Medellín, Antioquia, Colombia Arroyo Consulting A tiempo completo

    We're looking for a skilled Data Architect to join our team at Arroyo Consulting. As a Data Architect, you will be responsible for designing data models, creating data flow diagrams, and translating business requirements into solutions. Your expertise will help us optimize databases for performance, scalability, and security.Key Responsibilities:Designing...

  • Data Solutions Architect

    hace 3 semanas


    Medellín, Antioquia, Colombia Provectus IT, Inc. A tiempo completo

    Data Solutions Architect Job DescriptionOur company Provectus IT, Inc. is looking for a skilled Data Solutions Architect to lead the design, architecture, and implementation of large-scale data solutions for our clients. This role involves acting as a strategic technical leader, collaborating with cross-functional teams to deliver innovative data platforms...


  • Medellín, Antioquia, Colombia Provectus A tiempo completo

    Unlock the Power of Data with ProvectusAt Provectus, we're dedicated to empowering businesses with cutting-edge data solutions. As a Data Solutions Architect, you'll be at the forefront of designing and implementing large-scale data engineering platforms on AWS.Key Responsibilities:Lead high-impact customer engagements focused on Databricks Data Platform...


  • Medellín, Antioquia, Colombia Provectus IT, Inc. A tiempo completo

    Unlock the Power of Data with Provectus IT, Inc.About the RoleWe are seeking a highly skilled Data Solutions Architect to lead the design, architecture, and implementation of large-scale data solutions for our clients. As a key member of our Data Engineering team, you will collaborate with cross-functional teams to deliver innovative data platforms that...


  • Medellín, Antioquia, Colombia Token Metrics A tiempo completo

    Senior Crypto Data ArchitectAstra DAO is seeking a highly skilled Senior Crypto Data Architect to lead the development of our Data Scientists and Engineering team. The Senior Crypto Data Architect will be responsible for designing and implementing frameworks that prepare information using SQL, Python, R, Java, and C++. The Senior Crypto Data Architect will...


  • Medellín, Antioquia, Colombia Ci&T A tiempo completo

    The average salary for a data developer in Colombia ranges from $1,300 to $2,000 per month, depending on experience and qualifications.Ci&T is a tech transformation company that combines the disruptive power of Artificial Intelligence with human expertise to support large companies in navigating changes in technology and business.With 30 years of experience,...


  • Medellín, Antioquia, Colombia Advancio, Inc A tiempo completo

    Job Title: Advanced Cloud Data ArchitectAbout the RoleWe are seeking an experienced Cloud Data Architect to join our team at Advancio, Inc. This role offers a unique opportunity to leverage your technical expertise and shape the future of our data solutions.Job OverviewThis is an exciting opportunity for a highly skilled Cloud Data Architect to design,...


  • Medellín, Antioquia, Colombia NIX A tiempo completo

    We are seeking a highly skilled Senior Data Engineer to join our team at N-iX. Based in Medellin, this role offers a competitive salary and a range of benefits.Job Description:N-iX is looking for an experienced professional to lead the development of scalable data pipelines and ETL processes in the AWS environment. As a key member of our data engineering...

  • Data Solutions Architect

    hace 1 semana


    Medellín, Antioquia, Colombia Eagle Rocket Llc A tiempo completo

    Senior Data Engineer Job DescriptionWe are Eagle Rocket Llc, a boutique agency specializing in data analytics and insights for clients across various industries. Our team is seeking a skilled Senior Data Engineer to play a key role in building efficient data pipelines, running in-depth analysis, and developing insightful dashboards that drive impact for our...


  • Medellín, Antioquia, Colombia Parexel A tiempo completo

    Job DescriptionWe are looking for a highly skilled Cloud Architect to join our team. The successful candidate will have expertise in DevOps and be able to design and implement scalable cloud infrastructure solutions.Key Responsibilities:Design and implement cloud infrastructure solutionsDevelop and maintain DevOps processesCollaborate with cross-functional...

  • Data Architect

    hace 1 mes


    Medellín, Antioquia, Colombia Arroyo Consulting A tiempo completo

    About the RoleWe are seeking a highly skilled Data Architect to join our team at Arroyo Consulting. As a key member of our data team, you will be responsible for designing and implementing data models, creating data flow diagrams, and translating business requirements into actionable solutions.Key ResponsibilitiesDesign and implement data models, including...


  • Medellín, Antioquia, Colombia CI&T A tiempo completo

    Colombia Data Architect OpportunityWe are seeking a seasoned data architect leader to spearhead major data architecture projects, providing expert technical guidance and fostering a collaborative environment.Key Responsibilities:Lead data architecture projects, ensuring alignment with company culture and values.Mentor team members, promoting continuous...


  • Medellín, Antioquia, Colombia Sofka A tiempo completo

    Discover a new opportunity at Sofka, where innovation and growth thrive. We're offering an indefinite term contract for our Bilingual Solutions Architect role in Discovery services. Your mission will be to facilitate sessions with stakeholders and the tech team to define Minimum Viable Products (MVPs). Establish roadmaps and milestones for project or MVP...


  • Medellín, Antioquia, Colombia Kualty A tiempo completo

    **About the Role**Kualty is seeking a highly skilled Strategic Data Architect to join our team in Latin America.This is a 100% remote position, and we offer a competitive salary of $120,000 per year, paid in US dollars.You will have the opportunity to work on various projects, including data mart and dataset optimization, performance improvements, and design...

  • Senior Data Architect

    hace 4 semanas


    Medellín, Antioquia, Colombia CI&T A tiempo completo

    Data Architect Job DescriptionWe are CI&T, a tech transformation specialist that combines the disruptive power of Artificial Intelligence with human expertise. Our mission is to drive data innovation for global clients.Responsibilities:Design and develop scalable data infrastructure and workflows.Collaborate with cross-functional teams to ensure data...

  • Data Architect Position

    hace 4 semanas


    Medellín, Antioquia, Colombia Arroyo Consulting A tiempo completo

    We are seeking a highly skilled Data Architect to join our team at Arroyo Consulting. As a key member of our data management team, you will be responsible for designing and implementing data models, creating data flow diagrams, and translating business requirements into data solutions.Key ResponsibilitiesDesign and implement data models, including...


  • Medellín, Antioquia, Colombia Agileengine A tiempo completo

    About UsAgileEngine is a top-ranked dev shop, recognized as one of the Inc. 5000 fastest-growing companies in the US.We create award-winning custom software solutions that impact millions of lives across various industries.Job OverviewThis remote position requires a highly skilled Senior Software Architect to lead our data optimization and engineering...


  • Medellín, Antioquia, Colombia N-iX A tiempo completo

    N-iX is a leading software engineering and IT consulting company with expertise in data infrastructure.As a Lead Data Infrastructure Architect, you will play a pivotal role in designing and implementing scalable data pipelines and ETL processes in AWS environment.The successful candidate will collaborate with a dynamic team to transform raw data into...