Senior Data Engineer

hace 4 semanas


Colombia PayJoy Inc. A tiempo completo
About PayJoy

PayJoy is a mission-first financial service provider dedicated to helping under-served customers in emerging markets achieve financial stability and success. Our patented technology turns a smartphone into digital collateral, and our cutting-edge machine learning, data science, and anti-fraud AI enable us to offer the lowest cost and qualify the most customers in the industry.

This Role

As a Senior Data Engineer, you will play a key role in designing, developing, and maintaining scalable and efficient data pipelines to support the organization's data needs. You will be responsible for ensuring the smooth and reliable flow of data across various systems and platforms, enabling teams to access accurate and actionable data for decision-making.

Responsibilities
  • Design and Develop Data Pipelines: Build, optimize, and maintain reliable, scalable, and efficient data pipelines for both batch and real-time data processing.
  • Data Strategy: Develop and maintain a data strategy aligned with business objectives, ensuring data infrastructure supports current and future needs.
  • Tool & Technology Selection: Evaluate and implement the latest data engineering tools and technologies that will best serve our needs, balancing innovation with practicality.
Performance Tuning
  • Regularly review, refine, and optimize SQL queries across different systems to maintain peak performance.
  • Identify and address bottlenecks, query performance issues, and resource utilization.
  • Setup best practices and work with developers on education of what they should be doing in the software development lifecycle to ensure optimal performance.
Database Administration
  • Manage and maintain production AWS RDS MySQL, Aurora, and Postgres databases, replicas ensuring their reliability and availability.
  • Perform routine database operations, including backups, restores, and disaster recovery planning.
  • Monitor database health, diagnose, and resolve issues in a timely manner.
Knowledge and Training
  • Serve as the primary point of contact for database performance and usage-related knowledge, providing guidance, training, and expertise to other teams and stakeholders.
  • Monitoring & Troubleshooting: Implement monitoring solutions to ensure high availability and troubleshoot data pipeline issues in real-time.
  • Documentation: Maintain comprehensive documentation of systems, pipelines, and processes for easy onboarding and collaboration.
  • Collaboration: Work closely with data science, analytics, and product teams to understand data requirements and deliver tailored data solutions.
Requirements
  • Experience: 5+ years of experience in data engineering.
  • Technical Expertise: Deep understanding of data engineering concepts, including ETL/ELT processes, data warehousing, big data technologies, and cloud platforms (e.g., AWS, Azure, GCP).
  • Programming Skills: Proficiency in programming languages such as Python, Scala, or Java, and experience with SQL and NoSQL databases.
  • Knowledge of best practices in cloud database administration, including parameter tuning, backup, capacity management, and performance tuning.
  • Architectural Knowledge: Strong experience in designing and implementing data architectures, including real-time data processing, data lakes, and data warehouses.
  • Tool Proficiency: Hands-on experience with data engineering tools such as Apache Spark, Kafka, Snowflake, Airflow, Databricks, and modern data orchestration frameworks.
  • Innovation Mindset: A track record of implementing innovative solutions and reimagining data engineering practices.
  • Education: Bachelor's or Master's degree in Computer Science, Engineering, Data Science, or a related field.
Benefits
  • Local benefits will change according to the candidate's location.
  • $2,000 USD annual Coworking Travel allowance.
  • $2,000 USD annual Professional Development allowance.
  • $500 USD annual Fitness allowance.
  • $500 USD Phone Finance allowance.
  • $250 USD Home Office equipment allowance.
  • $200 USD Headphone allowance.

PayJoy is proud to be an Equal Employment Opportunity employer and we welcome and encourage people of all backgrounds. We do not discriminate based upon race, religion, color, national origin, gender (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics.

Finance for the next billion * Ownership * Break Through Walls * Live Communication * Transparency & Directness * Focus on Scale * Work-Life Balance * Embrace Diversity * Speed * Active Listening


  • Senior Data Engineer

    hace 6 meses


    Colombia Provectus IT, Inc. A tiempo completo

    **Senior Data Engineer**: Medellín, Antioquia, Bogotá, Capital District, San Jose **About project** We are seeking a talented and experienced** Senior Data Engineer** to join our team at Provectus. You will encounter numerous technical challenges and have the opportunity to contribute to exciting open-source projects (e.g., ODD, UI for Kafka), build...

  • Senior Data Engineer

    hace 6 meses


    Colombia Blankfactor A tiempo completo

    It's fun to work in a company where people truly BELIEVE in what they're doing! We're committed to bringing passion and customer focus to the business. About us At Blankfactor, we are dedicated to engineering impact. We are passionate about creating value by building best-in-class tech solutions for companies looking to transform, innovate, and scale....

  • Senior Data Engineer

    hace 2 semanas


    Colombia Monokera A tiempo completo

    ¡En Monokera buscamos un Senior Data Engineer apasionado y con visión estratégica! Serás una pieza clave en el diseño, implementación y mejora de soluciones analíticas basadas en Big Data. Compartirás con un equipo talentoso, promoverás las mejores prácticas en la arquitectura de datos y colaborarás con otros equipos en proyectos de alto...


  • Colombia Adage Tech SAS A tiempo completo

    At Adage Tech SAS, we continue to grow and want you to be part of our future talents! We are looking for a **Senior Azure Data Engineer** in Colombia to create data pipelines, perform some database administration, and other Azure data related tasks. **Requirements**: - Advanced English Level (B2) - 5+ years of experience - Data engineering - SQL - ADF -...

  • Senior Data Engineer

    hace 2 semanas


    Colombia Gorilla Logic A tiempo completo

    Senior Data Engineer Gorilla Logic is looking for a Senior Data Engineer. This is a unique and highly technical role responsible for data analysis within the enterprise. This role works with multiple data sources, data aggregation into data lakes, and data transformation into value. Our environment will require you to work effectively with your...


  • Colombia AgileEngine, LLC A tiempo completo

    Key ResponsibilitiesAs a Senior Data Orchestration Engineer at AgileEngine, LLC, you will be responsible for designing and implementing a clear and lean data model that outlines data sources and transformations using DAGs and data orchestration tools like Dagster or Airflow.Key ResponsibilitiesData Model Design: Design a data model that outlines data sources...

  • Senior Data Engineer

    hace 4 semanas


    Colombia Token Metrics Inc A tiempo completo

    Astra DAO is seeking a highly skilled Senior Crypto Data Engineer to drive the success of our Data Scientists and Engineering team. The ideal candidate will be responsible for designing and implementing scalable data architectures, leveraging various tools and techniques to construct frameworks that prepare information using SQL, Python, R, Java, and C++.Key...


  • Colombia AgileEngine, LLC A tiempo completo

    Job SummaryWe are seeking a highly skilled Senior/Lead Data Orchestration Engineer to join our team at AgileEngine, LLC. As a key member of our data engineering team, you will be responsible for designing and implementing data pipelines, ensuring data quality, and collaborating with cross-functional teams to drive business outcomes.Key ResponsibilitiesData...


  • Colombia FullStack Labs A tiempo completo

    About the Role:We're seeking a highly skilled Senior Databricks Data Engineer to join our team at FullStack Labs. As a key member of our team, you'll work closely with our clients to design and implement scalable data engineering solutions using Databricks.Key Responsibilities:Design and develop complex data pipelines using DatabricksCollaborate with...

  • Cloud Data Engineer

    hace 4 semanas


    Colombia Mechanized AI A tiempo completo

    Job Title: Senior Cloud Backend EngineerJob Summary:We are seeking a highly skilled Senior Cloud Backend Engineer to join our team at Mechanized AI. As a key member of our engineering team, you will be responsible for designing and building cloud architectures for data-centric products end-to-end. Your expertise in Python, Flask, and cloud data technologies...


  • Colombia Lean Tech A tiempo completo

    Company Overview: Lean Tech is a rapidly expanding organization with a strong presence in the software development and IT services sectors. We pride ourselves on our extensive network and expertise in delivering cutting-edge solutions for the entertainment, financial, and logistics industries. Our corporate vision offers numerous opportunities for...

  • Junior Data Engineer

    hace 1 semana


    Colombia NTT DATA COLOMBIA SAS A tiempo completo

    Junior Data Engineer (Microsoft Azure) - Remoto Colombia Trabaja en NTT DATA COLOMBIA SAS Salario: $2,5 a $3 millones Publicado: 6 Nov 2024 Categoría: Sistemas y Tecnología NTT DATA, con sede en Tokio, es la 6ª compañía proveedora de servicios de TI del mundo, cuenta con 140.000 profesionales y opera en más de 50 países. Descripción...

  • Cloud Data Engineer

    hace 1 mes


    Colombia Mechanized AI A tiempo completo

    Job Title: Senior Cloud Backend EngineerJob Type: Full-TimeLocation: Remote (Any Location)Company Overview:Mechanical AI is a pioneer in AI innovation, leveraging cutting-edge technology to transform legacy systems into modern, efficient, and scalable solutions. We collaborate with enterprise clients to breathe life into their existing software, ensuring...

  • Cloud Data Engineer

    hace 4 semanas


    Colombia Mechanized AI Inc. A tiempo completo

    Job Title: Senior Cloud Backend EngineerJob Type: Full-TimeLocation: Remote (Any Location)Company Overview:Mechanical AI Inc. is a pioneering force in AI innovation, leveraging cutting-edge technology to transform legacy systems into modern, efficient, and scalable solutions. We collaborate with enterprise clients to breathe life into their existing...

  • Senior Data Engineer

    hace 4 semanas


    Colombia Kin + Carta A tiempo completo

    About the RoleKin + Carta is seeking a highly skilled Senior Spark Data Engineer to join our growing capabilities team. As a key member of our team, you will be responsible for designing and implementing scalable data pipelines, ensuring high-quality data, and collaborating with cross-functional teams to drive business outcomes.Key ResponsibilitiesDesign and...

  • Senior Data Engineer

    hace 4 semanas


    Colombia AgileEngine, LLC A tiempo completo

    Job Title: Senior/Lead Data EngineerJob Summary:We are seeking a highly skilled Senior/Lead Data Engineer to join our team at AgileEngine, LLC. The ideal candidate will have a strong background in data engineering, marketing automation, and CRM solutions.Key Responsibilities:Design and develop data architectures for marketing automation and CRM...


  • Colombia NEORIS A tiempo completo

    NEORIS, a Digital accelerator with 20 years of experience as Digital Partners of large companies, is seeking a Senior Cloud Data Engineer with GCP Expertise.About the Role:We are looking for a highly skilled Cloud Data Engineer to join our team. The successful candidate will have expertise in GCP, SQL, and Python, with a strong focus on data extraction,...


  • Colombia PayJoy Inc. A tiempo completo

    About PayJoy PayJoy is a mission-first financial service provider dedicated to helping under-served customers in emerging markets to achieve financial stability and success. We lend through our patented technology that turns a smartphone into digital collateral, and our cutting-edge machine learning, data science, and anti-fraud AI allow us to offer the...

  • Senior Data Engineer

    hace 5 meses


    Colombia, Huila Cooperative Computing A tiempo completo

    **Cooperative Computing (CC):  We accelerate growth minded companies into the automated economy**. The business market is in rapid change, with consumer behavior placing significantly high expectations on businesses at every phase in the client experience.  Each day, we experience a company dramatically shifting “industry norms” and in many cases,...

  • Senior Data Engineer

    hace 4 semanas


    Colombia BairesDev A tiempo completo

    Unlock Your Potential as a Data Engineer at BairesDevAt BairesDev, we're revolutionizing the tech industry with cutting-edge solutions for top clients like Google. Our diverse team of 4,000+ experts, comprising the world's top 1% of tech talent, works remotely on projects that drive significant impact globally.We're seeking a talented Data Engineer to join...