Senior Spark Data Engineer
hace 3 días
**The opportunity**:
At Kin + Carta, we’ve got opportunities to offer you — for growth, for leadership, for big, world-changing impact and for, dare we say it, fun. We are a global workforce that is committed to building a world that works better for everyone. And that starts with our Kin. That’s why we’re proud of:
- The life we create within our virtual walls, every day
- Being B Corp certified
- Our honor as a “Best Company to Work For” by Women's Choice Award
**The role**:
**Kin + Carta** is looking to hire **Senior Spark **Data Engineer **to join our growing capabilities team. If you are innovative, passionate about data and AI technologies, and look to continually learn and enjoy sharing expertise, read on
**Role responsibilities**:
- Demonstrate deep knowledge of the data engineering domain to build and support non-interactive (batch, distributed) & real-time, highly available data, data pipeline, and technology capabilities
- Build fault-tolerant, self-healing, adaptive, and highly accurate data computational pipelines
- Provide consultation and lead the implementation of complex programs
- Develop and maintain documentation relating to all assigned systems and projects
- Tune queries running over billions of rows of data running in a distributed query engine
- Perform root cause analysis to identify permanent resolutions to software or business process issues
**Minimum qualifications**:
**We want all new hires to succeed in their roles at Kin + Carta. That's why we've outlined the job requirements below. To be considered for this role, it's important that you meet all Minimum Qualifications. If you do not meet all of the Preferred Qualifications, we still encourage you to apply.**
- Proven industry experience executing data engineering, analytics and/or data science projects or Bachelors/Masters degree in quantitative studies including Engineering, Mathematics, Statistics, Computer Science or computation-intensive Sciences and Humanities.
- More than 7 years of experience working with:
1. Strong/expert Spark (PySpark) Using Jupyter Notebooks, Colab or DataBricks
2. Hands-on data pipeline development, ingest patterns in Azure
3. Orchestration tools, ADF or Airflow
4. SQL
5. Denormalized Data modeling for big data systems
- Collaborative, able to work remotely, and still be an engaging team member.
- Strong analytical and design skills.
**Preferred qualifications**:
- Proficiency in visualization/reporting tools such as Tableau and PowerBI or programmatic visualization library such as R ggplot2, Python matplotlib/seaborn/bokeh, Javascript D3.
- Proficiency scripting in UNIX environment
- Proficiency in big data environments and tools such as Spark, Hive, Impala, Pig, etc.
- Proficiency with cloud architecture components (AWS, Azure, Google)
- Proficiency with data pipeline software such as Airflow, Luigi, or Prefect
- Ability to turn raw data and ambiguous business questions into distilled findings and recommendations for action
- Experience leading and managing technical data/analytics/machine learning projects
**About Kin + Carta**:
Kin + Carta is a global digital transformation consultancy committed to working alongside our clients to build a world that works better #ForEveryone. Our 2,000 curious minds make creative connections between people, data and technology to create connected outcomes across the full lifecycle of the product and platform ecosystems.
We’re makers, builders and creators by nature, and we come to work every day to build experiences for some of the world’s most influential companies. We help businesses accelerate their digital roadmap, rapidly innovate, modernize their systems, enable their teams and optimize for continued growth.
We are a technology business with trust and human connection at its heart. As a Certified B Corp, our triple bottom line focus on people, the planet and profit is at the core of everything we do.
We welcome our Kin to show up as their authentic selves every day. Because this is so important to us, Kin + Carta is proud to be an equal opportunity employer. To read further about our commitment to Inclusion, Diversity, Equity and Awareness, check out the IDEA page on our website.
Whoever you are, wherever you’re from and whoever you love, you’ll find an open door at Kin + Carta. It’s yours to walk through if you’re passionate about building a better world for everyone, and you’re keen to be part of a diverse and inclusive culture that plays to people’s strengths and thrives on togetherness.
-
Senior Data Engineer
hace 1 día
Desde casa, Colombia Gorilla Logic A tiempo completo**Senior Data Engineer** Gorilla Logic is looking for a Senior Data Engineer. This is a unique and highly technical role responsible for data analysis within the enterprise. This role works with multiple data sources, data aggregation into data lakes, and data transformation into value. Our environment will require you to work effectively with your...
-
Senior Data Engineer
hace 7 meses
Desde casa, Colombia Provectus A tiempo completoWe are seeking a talented and experienced** Senior Data Engineer** to join our team at Provectus. You will encounter numerous technical challenges and have the opportunity to contribute to exciting open-source projects (e.g., ODD, UI for Kafka), build internal solutions, and engage in R&D activities, providing an excellent environment for professional...
-
Data Engineer
hace 7 meses
Desde casa, Colombia Formula.Monks A tiempo completoWe are lookin for a strategy-obsessed, problem-solving, and detail-loving** Data Engineer** to join the team! With solid experience pulling data from various databases into database objects. The specific tittle is **Senior Marketing Infrastructure & Automation Engineer.** This role will act as the senior technical lead on the team supporting the continuous...
-
Senior Data Engineer
hace 7 meses
Desde casa, Colombia Gorilla Logic A tiempo completo**Senior Data Engineer** **Responsibilities** - Design, build and maintain scalable and efficient data architectures, including databases, data warehouses, data lakes, data marts, and other storage solutions. - Design, build, and maintain robust data pipelines for the extraction, transformation, and loading (ETL) of data from various sources to storage and...
-
Senior Data Engineer
hace 7 meses
Desde casa, Colombia Growth Acceleration Partners A tiempo completo**Description**: We are seeking a Senior Data Engineer with a proven record of accomplishment in the design, development, maintenance, and operation of scalable, high-performance Data solutions primarily using PostgreSQL and SQL Server secondarily. This is a hands-on position that includes developing data technologies with Technology Team Leadership and...
-
Senior Data Engineer
hace 7 meses
Desde casa, Colombia Fusemachines A tiempo completo**About Fusemachines** Fusemachines is an artificial intelligence talent and education solutions company dedicated to democratizing AI. Headquartered in New York,US with operations in Dominican Republic, Canada, and Nepal, it is a 300+ company. Fusemachines' AI educational program has made world-class AI education available, accessible and affordable to...
-
Data Engineer
hace 7 meses
Desde casa, Colombia Formula.Monks A tiempo completoFormula.Monks is an Engineering and AI technology-driven consulting firm, and we offer IT solutions and consulting services. We consult, build, and scale the world’s most innovative brands. Are you a data engineer looking to join a leading technology company? Are you passionate about data and everything it powers? Are you ready to help people travel, go...
-
Senior Data Engineer
hace 7 meses
Desde casa, Colombia Gorilla Logic A tiempo completo**Senior Data Engineer (Java/GCP)** **Responsibilities** - Design, build and maintain scalable and efficient data architectures, including databases, data warehouses, data lakes, data marts, and other storage solutions. - Design, build, and maintain robust data pipelines for the extraction, transformation, and loading (ETL) of data from various sources to...
-
Senior Data Engineer
hace 7 meses
Desde casa, Colombia Gorilla Logic A tiempo completo**Senior Data Engineer (Java/GCP)** **Responsibilities** - Design, build and maintain scalable and efficient data architectures, including databases, data warehouses, data lakes, data marts, and other storage solutions. - Design, build, and maintain robust data pipelines for the extraction, transformation, and loading (ETL) of data from various sources to...
-
Senior Data Engineer
hace 5 días
Desde casa, Colombia Gorilla Logic A tiempo completoGorilla Logic is looking for a Senior Data Engineer with exceptional analytics and reporting skills to work as a member of an Agile team responsible for building and maintaining our client’s data warehouse, reports, and dashboards. Our environment will require you to work effectively with your teammates, of course. But your real success will be measured by...
-
Senior Data Engineer
hace 7 meses
Desde casa, Colombia Gorilla Logic A tiempo completo**Senior Data Engineer** Gorilla Logic is looking for a Sr. Data Engineer, who will assist in organizing our client's system data into dashboards and on demand reports. This is a unique and highly technical role, requiring strong database and reporting experience in delivering leading-edge solutions. Our environment will require you to work effectively with...
-
Data Engineer
hace 7 meses
Desde casa, Colombia TEAM International Services A tiempo completoOur client is a global professional services firm committed to delivering quality in assurance, advisory, and tax services. Financial Crime team works at the forefront of risk management, leveraging advanced technologies and analytics to combat financial crimes and safeguard our clients' interests. Data Pipeline Development: - Design and implement robust,...
-
Data Engineer
hace 7 meses
Desde casa, Colombia Intellias A tiempo completoProject Overview: Our customer is a US based international company on the Fortune 500 list. They provide energy, logistics, and technology solutions to aviation, marine, and land customers and suppliers around the world. Their solutions include oil and energy procurement, distribution and storage, operations support, financial, consulting, and technology...
-
Senior Data Engineer
hace 1 semana
Desde casa, Colombia Gorilla Logic A tiempo completo**Senior Data Engineer (Java)** Gorilla Logic is looking for a Senior Data Engineer, you will utilize your hand-on experience to design and develop reliable and scalable data solutions, working as a member of an Agile team responsible for building and maintaining our client's software as a service solution. Our environment will require you to work...
-
Data Architect/data Security Engineer Seta
hace 7 meses
Desde casa, Colombia Convergenz A tiempo completo**Role**: Data Architect/Data Security Engineer Tech SETA **Duties**: - Provide technical guidance to external teams working on large-scale data projects - Ensure robust and scalable data solutions are implemented, with a strong focus on security and compliance - Analyze scientific and technical data with respect to novelty, rigor, and robustness -...
-
Senior Data Engineer
hace 7 meses
Desde casa, Colombia Provectus A tiempo completo**Responsibilities**: - Collect and manage large volumes of varied data sets; - Work directly with Data Scientists and ML Engineers to create robust and resilient data pipelines that feed Data Products; - Define data models that integrate disparate data across the organization; - Design, implement, and maintain ETL pipelines; - Develop and continuously test...
-
Data Engineer
hace 7 meses
Desde casa, Colombia Dev.Pro A tiempo completoAre you in Colombia, Argentina, Brazil, Chile, or Costa Rica? Join us as we actively recruit in these locations, offering a comfortable remote environment. Submit your CV in English, and we’ll get back to you! We invite a skilled Data Engineer to join a US/UAE-based Fintech project — a digital asset management platform integrated with both fiat and...
-
Senior Data Engineer
hace 7 días
Desde casa, Colombia Olive Tree Holdings A tiempo completo**Olive Tree is growing!** We are adding a Senior Data Engineer to the Colombia team! **Who are we?** Olive Tree is an international Technology Venture Fund launching our LATAM Tech Hub. Olive Tree is the owner of a diverse portfolio of assets and established operator in the Commercial Real Estate space with offices in New York City, Atlanta, Houston, and...
-
Senior Python Data Engineer
hace 7 meses
Desde casa, Colombia Lean Tech A tiempo completoLean Tech is a fast-growing company located in Medellín, Colombia. We currently have one of the most prominent networks within the entertainment, financial, and logistics industries. Our corporate projections represent hundreds of opportunities for our professionals to grow and boost their careers. Working with us means collaborating with large engineering...
-
Data Engineer
hace 3 días
Desde casa, Colombia Smart Talent IT A tiempo completo**Un cordial saludo, en Smart Talent tenemos una vacante denominada “Data Engineer” que te puede interesar a ti o a alguno de tus compañeros, así que no dejes de compartirla. 100% Trabajo remoto.** **Salario hasta COP $ 12.000.000 según conocimientos y experiência, la cual debe ser mínimo de 3 años.** **Perfil**: **Buscamos un Data Engineer para...