Senior Data Cloud Engineer Top U.s. Web

hace 7 días

Bogota, Colombia Prometeo Talent A tiempo completo

At this time, we are looking for a motivated **Data Engineer** who can collaborate with our team to deliver great things on time with high quality. You will have the opportunity to build amazing web and mobile experiences by working closely with other engineers, systems architects to help aggregate the data stream, direct the flow of data within the pipeline and ensure consistency of data delivery and utilization of reporting and data analytic systems.

**Responsibilities**
- Work closely with system architects and distributed computing engineers and reporting/data warehouse developers to create and optimize the architecture of the streaming data pipeline
- Design and build the streaming data pipeline to transform, aggregate and store the data
- Always angle for greater efficiency and robustness of the pipeline to support big volume of data stream
- Maintain and support the HDP/HPC Azure cloud environment
- Support the Azure Replication and DR environment
- Some possible work occasionally with C# and SQL Server.

**Qualifications**
- Graduate degree in Computer Science, Information Systems or equivalent quantitative field and 5+ years of experience in a similar Data Engineer role.
- Demonstrated ability to build processes that support data stream consumption, data transformation, data structures, metadata, dependency and workload management
- Strong interpersonal skills and ability to work with cross-functional teams
- Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.
- Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
- Basic knowledge in network configuration, firewall and security, etc.
- Basic Hadoop Administration skills like
- Managing / Monitoring the Hadoop cluster connectivity and performance.
- Taking care of day to day running of Hadoop clusters.
- Manage and review the Hadoop Logs / Backup and recovery tasks
- Troubleshooting issues related to Hadoop Cluster.

**Experience with the following tools and technologies**:

- Big data experience, but preferred hadoop ecosystem distributions such as HDP, Cloudera etc. Cloudera is preferred
- Public cloud such as Azure, AWS etc. Azure is preferred
- Apache Hive
- Apache Kafka
- Spark-Streaming
- Object-oriented/object function scripting languages such as Python, Scala, C#.net etc.
- Azure DevOps and CI/CD Pipeline
- HPC Windows Pack and auto-grow/shrink
- SQL Server, TSQL, etc
- C#.net

**What we offer?**
- 100% remote work
- Salary in USD paid directly in a US Bank Account
- Signing loan, so you can start working with a Mac Computer
- More than 3 weeks of Paid Time Off

  • Senior Data Engineer

    hace 1 día

    Bogota, Colombia Levee A tiempo completo

    **About Levee** We are on a mission to transform the way companies hire and manage their people. We are backed by the leading workforce, AI and impact investors globally including 8VC, Trust Ventures, Acumen, Andreessen Horowitz' Latam-anchored Fund, Latitud. Our AI-driven software reduces bias in hiring practices, leading to increased...

  • Arquitecto/a de Datos Senior

    hace 7 días

    Bogota, Colombia HITSS Colombia S.A.S A tiempo completo

    Descripción de la oferta - ¡Buscamos a las personas adecuadas, personas que deseen innovar, crear, liderar, transformar! Queremos atraerte, pero más allá de eso queremos contar con el mejor talento, estamos comprometidos con el desarrollo profesional de cada uno de nuestros colaboradores. Queremos que experimentes los desafíos, recompensas y...

  • Cloud Data Engineer

    hace 7 días

    Bogota, Colombia Bluetab Solutions SAS A tiempo completo

    **Descripción**: Consiste en un rol técnico que participa en proyectos que involucran el despliegue de servicios de nube (previamente diseñados por un cloud data architect) que típicamente conforman esquemas de datalake/deltalake y datawarehouse en la nube, ingesta de datos, integración, transformación, aplicación de reglas de negocio y...

  • Senior Data Engineer

    hace 1 día

    (s): Colombia : Bogota : Bogota Scotiabank Global Site A tiempo completo

    Requisition ID: 241837Thanks for your interest in ScotiaTech, Scotiabank's new and innovative Technology hub in Bogota.Join a purpose driven winning team that promotes creativity and innovation in a fast-paced environment, where we're always committed to results, in an inclusive, diverse, and high-performing culture.PurposeThe Senior Data Engineer will lead...

  • Customer Engineer, Data Analytics, Google Cloud

    hace 2 semanas

    Bogota, Colombia Google A tiempo completo

    **In-office locations: Bogotá, Bogota, Colombia.** **Remote location(s): Colombia.** Minimum qualifications: - Bachelor's degree in Computer Science, IT, or related field, or equivalent practical experience. - Experience with traditional Analytic Warehouse solutions and Big Data technologies. - Experience implementing analytics systems architecture,...

  • Data Engineer

    hace 1 día

    (s): Colombia : Bogota : Bogota Scotiabank Global Site A tiempo completo

    Requisition ID: 241841Thanks for your interest in ScotiaTech, Scotiabank's new and innovative Technology hub in Bogota.Join a purpose driven winning team that promotes creativity and innovation in a fast-paced environment, where we're always committed to results, in an inclusive, diverse, and high-performing culture.PurposeThe Data Engineer will design,...

  • Cloud Engineer Developer

    hace 2 semanas

    Bogota, Colombia Chiper A tiempo completo

    **About Chiper** Chiper is a tech Startup present in Colombia, Mexico and Brazil. Through its e-commerce platform, it offers mass consumer products at direct manufacturer prices to independent businesses such as neighborhood stores, liquor stores, mini-markets, among others. Our purpose is to create bridges between low and middle-income people who are...

  • Senior Data Engineer

    hace 3 días

    Bogota, Colombia AgileEngine A tiempo completo

    ID: 14686 **What you will do** - Design and implement data pipelines using DBT for transformation and modeling; - Manage and optimize data warehouse solutions on Snowflake; - Develop and maintain ETL processes using Fivetran for data ingestion; - Utilize Terraform for infrastructure as code (IaC) to provision and manage resources in AWS, Snowflake,...

  • Programador Salesforce

    hace 1 semana

    Bogota, Colombia Cloud Avengers A tiempo completo

    Desarrollar, personalizar e integrar aplicaciones Salesforce utilizando APEX, LWC y otras tecnologías relacionadas. - Colaborar con equipos multifuncionales para recopilar y traducir los requisitos comerciales en soluciones técnicas. - Crear y mantener código eficiente, reutilizable y confiable. - Solucionar y resolver problemas en Salesforce e...

  • Senior Data Engineer

    hace 1 día

    Bogota, Colombia Infoblox A tiempo completo

    It’s an exciting time to be at Infoblox. Named a Top 25 Cyber Security Company by The Software Report and one of _Inc_. magazine’s Best Workplaces for 2020, we are leading the way to next-level DDI with our Secure Cloud-Managed Network Services, bringing next-level security, reliability, and automation to cloud and hybrid systems—all managed through a...