Senior Spark Data Engineer

hace 6 meses

Bogota, Colombia Kin + Carta A tiempo completo

**The opportunity**:
At Kin + Carta, we’ve got opportunities to offer you — for growth, for leadership, for big, world-changing impact and for, dare we say it, fun. We are a global workforce that is committed to building a world that works better for everyone. And that starts with our Kin. That’s why we’re proud of:

- The life we create within our virtual walls, every day
- Our B Corp certification
- Being Great Place to Work certified in all eligible countries
- The work we’ve done with some of the world’s most innovative companies

**The role**:
**Kin + Carta** is looking to hire a **Senior Spark Data Engineer **to join our growing team. If you are innovative, passionate about data and AI technologies, and look to continually learn and share your expertise, read on

**Due to the sensitive nature of this client project, this role requires you to be onsite in our Bogotá office 5 days a week.**

**Role responsibilities**:

- Demonstrate deep knowledge of the data engineering domain to build and support non-interactive (batch, distributed) & real-time, highly available data pipelines
- Build fault-tolerant, self-healing, adaptive, and highly accurate data computational pipelines
- Provide consultation and lead the implementation of complex programs
- Develop and maintain documentation relating to all assigned systems and projects
- Tune queries running over billions of rows of data running in a distributed query engine
- Perform root cause analysis to identify permanent resolutions to software or business process issues

**Minimum qualifications**:
**We want all new hires to succeed in their roles at Kin + Carta. That's why we've outlined the job requirements below. To be considered for this role, it's important that you meet all Minimum Qualifications. If you do not meet all of the Preferred Qualifications, we still encourage you to apply.**
- Proven industry experience executing data engineering, analytics, and/or data science projects or Bachelors/Masters degree in quantitative studies including Engineering, Mathematics, Statistics, Computer Science or computation-intensive Sciences and Humanities.
- More than 5 years of experience working with:
1. Strong/expert Spark (PySpark) Using Databricks, Jupyter Notebooks, or Colab
2. Hands-on data pipeline development, ingest patterns in Azure orchestration tools such as Azure Data Factory (ADF) or Airflow
3. SQL
4. Denormalized Data modeling for big data systems
- Collaborative, proactive, communicative, able to work remotely while remaining engaged as a team member.
- Strong analytical and design skills.

**Preferred qualifications**:

- Familiarity with visualization/reporting tools such as Tableau and PowerBI.
- Familiarity with semantic/metadata layer tools such as Databricks Unity Catalog and Azure Purview
- Proficiency scripting in UNIX environment
- Proficiency in big data environments and tools such as Spark, Hive, Impala, Pig, etc.
- Proficiency with cloud architecture components (AWS, Azure, Google)
- Proficiency with data pipeline software such as Airflow, Azure Data Factory, or Prefect
- Experience leading and managing technical data/analytics/machine learning projects

**About Kin + Carta**:
Kin + Carta is a global digital transformation consultancy committed to working alongside our clients to build a world that works better #ForEveryone. We build digital solutions that connect people, data and technology for some of the world’s most influential companies. As a Certified B Corp, we are committed to Inclusion, Diversity, Equity and Awareness, and our triple bottom line focus of people, the planet and profit.

Whoever you are, wherever you’re from and whoever you love, you’ll find an open door at Kin + Carta. It’s yours to walk through if you’re passionate about building a better world for everyone, and you’re keen to be part of a diverse and inclusive culture that plays to people’s strengths and thrives on togetherness.

  • Senior Data Engineer

    hace 6 meses

    Bogota, Colombia UBITS A tiempo completo

    **UBITS** es el hub de educación online de habla hispana, en donde, diseñas, ejecutas y mides tu estrategia de entrenamiento. Actualmente estamos buscando a nuestro próximo Senior Data Engineer, altamente talentoso y apasionado por la tecnología para unirse a esta emocionante misión. Nos enfocamos en la gestión y análisis de datos en un entorno...

  • Senior Data Engineer

    hace 6 meses

    Bogota, Colombia NielsenIQ A tiempo completo

    **Company Description** Join GfK and help us shape tomorrow. As an NIQ company, we are the world's leading consumer intelligence firm, delivering the Full View on consumer behavior. We work to enable manufacturers and retailers better understand what consumers really want. Our name has inspired trust for over 89 years because we take pride in discovering new...

  • Senior Data Engineer

    hace 6 meses

    Bogota, Colombia GfK A tiempo completo

    Country Colombia Job Family Technology We show the world what people want. Join GfK and help us shape tomorrow. As an NIQ company, we are the world's leading consumer intelligence firm, delivering the Full View on consumer behavior. We work to enable manufacturers and retailers better understand what consumers really want. Our name has inspired trust...

  • Jr. Data Engineer

    hace 6 meses

    Bogota, Colombia Devlane A tiempo completo

    Hello there! We are Devlane, a software development company with presence across all of LATAM, that’s currently offering staff augmentation services to clients around the world, with a special focus in North America. With us, you’ll have a real opportunity to shine and leave a footprint on the project you are assigned to since most of our clients are...

  • Data Engineer Senior

    hace 6 meses

    Bogota, Colombia STEFANINI LATAM A tiempo completo

    ¡Sé parte de Stefanini! En Stefanini somos más de 30.000 genios, conectados desde 41 países, haciendo lo que les apasiona y co-creando un futuro mejor. ¡Se nuestro Data Engineer Senior! **Responsabilidades y atribuciones** **Responsabilidades**: - Conocer y dominar los servicios y productos de la nube, especialmente los relacionados con el...

  • Senior Data Engineer

    hace 6 meses

    Bogota, Colombia Encora A tiempo completo

    At Encora we are looking for a great talent like you to join our team as the next Senior Data Engineer (76) Would you like to join our great team of engineers? Here we will tell you more about us and the role! **About the role**: As a Senior Data Engineer, you will be part of a highly skilled technology and agile team by supporting and developing...

  • Data Engineer

    hace 6 meses

    Bogota, Colombia Amaris Consulting A tiempo completo

    **Who are we? **:Amaris Consulting es una firma independiente de asesoría tecnológica que ofrece servicios de orientación y soluciones para las empresas. Reúne a más de 7 600 personas distribuidas en 5 continentes y más de 60 países. Con más de 1 000 clientes en todo el mundo, hemos implementado soluciones en proyectos importantes durante más de una...

  • Data Engineer

    hace 6 meses

    Bogota, Colombia amaris A tiempo completo

    Job description Buscamos consultores dinámicos para hacer crecer nuestro equipo de Sistemas de Información y Digital en Colombia. Tu experiência, conocimiento y compromiso nos ayudarán a afrontar los retos de nuestros clientes. Estarás apoyando diferentes proyectos a través de tu experiência como Data Engineer. **Sus principales...

  • Data Engineer Senior

    hace 3 meses

    Bogota, Colombia STEFANINI LATAM A tiempo completo

    ¡Sé parte de Stefanini!En Stefanini somos más de 30.000 genios, conectados desde 41 países, haciendo lo que les apasiona y co-creando un futuro mejor.¡Se nuestro Data Engineer Senior!**Responsabilidades y atribuciones****Responsabilidades**:- Conocer y dominar los servicios y productos de la nube, especialmente los relacionados con el almacenamiento,...

  • Senior Data Engineer

    hace 6 meses

    Bogota, Colombia Univision communications inc A tiempo completo

    ABOUT THE ROLE & TEAM: TelevisaUnivision is the leading Spanish-language media company in the world! We’re investing in our content, our people, and our properties, which span digital, streaming, social, audio, linear and live events. We’re growing our offerings, building on the launch of our successful streaming platform ViX. The Data and Analytics...

  • Data Engineer

    hace 6 meses

    Bogota, Colombia ServiceTitan A tiempo completo

    Ready to be a Titan? Play a pivotal role as a Data Engineer. Enterprise Data Engineering is part of the Data Services team. The Data Engineering team builds database solutions for various enterprise use cases including analytics, data science, and financial reporting. We want data to be at the core of everything that the company does. This is an exciting...

  • Data Engineer

    hace 3 meses

    Bogota, Colombia amaris A tiempo completo

    Job descriptionBuscamos consultores dinámicos para hacer crecer nuestro equipo de Sistemas de Información y Digital en Colombia. Tu experiência, conocimiento y compromiso nos ayudarán a afrontar los retos de nuestros clientes.Estarás apoyando diferentes proyectos a través de tu experiência como Data Engineer.**Sus principales...

  • Data Engineer Expert

    hace 6 meses

    Bogota, Colombia Globant A tiempo completo

    We are a digitally native technology services company where innovation, design, and engineering meet scale. We use some of the latest technologies in the digital and cognitive field to empower organizations in every aspect. Right now, we are looking for a **Data Engineering Expert** to be part of our Data & AI Studio with more than 500 professionals...

  • Senior Data Engineer

    hace 6 meses

    Bogota, Colombia Multiplica Talent A tiempo completo

    **Responsibilities**: - Create and maintain optimal data pipeline architecture, - Assemble large, complex data sets that meet functional / non-functional business requirements. - Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. -...

  • Data Engineer

    hace 6 meses

    Bogota, Colombia Nexos Software S.A,S A tiempo completo

    Técnico, tecnólogo o profesional en Ingeniería de Sistemas o carreras afines, con mínimo 2 años de experiência en Bases de Datos, SQL avanzado, Analítica de Big Data (procesamiento, ingesta y limpieza). Conocimientos en: Python, Scala y Spark.. Deseables: Clúster de Hadoop, Apache NiFi, HQL (Hibernate Query Language) Lugar de Trabajo: Bogotá -...

  • Lead Data Engineer

    hace 6 meses

    Bogota, Colombia AgileEngine A tiempo completo

    ID: 15982 **What you will do** - Migrate Indeed search index builders from old framework to Apache Spark and AWS; - Providing Apache Spark best practices and mentoring; - Producing high-quality code; - Communication with Engineering & Product management; - Alignment with existing development teams. **Must haves** - 4+ years experience in software...

  • Senior Data Engineer

    hace 6 meses

    Bogota, Colombia Univision communications inc A tiempo completo

    TelevisaUnivision is the leading Spanish-language media company in the world! We’re investing in our content, our people, and our properties, which span digital, streaming, social, audio, linear and live events. We’re growing our offerings, building on the launch of our successful streaming platform ViX. The Data Engineering team at TelevisaUnivision...

  • Senior Data Engineer

    hace 6 meses

    Bogota, Colombia AgileEngine A tiempo completo

    ID: 14808 **What you will do** - Responsibilities Designing and implementing efficient data pipelines (ETLs) in order to integrate data from a variety of sources into Indeed’s Data Warehouse; - Designing and implementing data model changes that align with warehouse standards; - Providing documentation, training, and consulting for data warehouse...

  • Senior Data Engineer

    hace 6 meses

    Bogota, Colombia Procalidad SAS A tiempo completo

    Si cumples con los siguientes requisitos: - Eres Ingeniero de Sistemas o áreas afines - Tienes sólidos conocimientos de tecnologías de bases de datos (por ejemplo, bases de datos SQL, bases de datos NoSQL, AWS Redshift, Redshift Spectrum, DocumentDB y bases de datos en columnas). - Cuentas con fuerte competencia en modelado de datos, conceptos de...

  • Senior Data Engineer

    hace 2 meses

    Bogota, Colombia Procalidad SAS A tiempo completo

    Si cumples con los siguientes requisitos:- Eres Ingeniero de Sistemas o áreas afines- Tienes sólidos conocimientos de tecnologías de bases de datos (por ejemplo, bases de datos SQL, bases de datos NoSQL, AWS Redshift, Redshift Spectrum, DocumentDB y bases de datos en columnas).- Cuentas con fuerte competencia en modelado de datos, conceptos de...