Data Quality Engineer

hace 2 días


Desde casa, Colombia EPAM Systems A tiempo completo

Be responsible for data product testing and quality of deliverables on the project

Data quality implementation and improving data quality as the main goal

Establish data testing approach and test design, data quality checks across the data lifecycle

Work on priorities to achieve better data quality on the project within a tight schedule

Design and implement data testing strategy concerning system architecture and data flows

Plan and estimate required resources to conduct data product/flow testing and validation concerning company/industry / governmental standards

Design and develop a data quality framework according to the identified data product strategy (define critical data, controls, and quality targets, set thresholds and alerts, etc)

Understand, design, and implement automated data quality checks

**REQUIREMENTS**:

- Engineering experience and practice in Data Management, Data Quality verification/Data Governance, Data Visualization testing, Data Integration
- Familiar with concepts of data ingestion pipelines, and data storage like OLTP databases, Data Warehousing, Data Lakes
- Understanding of the ETL process and test strategy for ETL
- Strong SQL experience
- Experience with scripting/automation
- Knowledge and practical experience in data validation
- Familiar with test documentation concepts, such as test strategies, test plans, etc
- Familiar with testing methods - TDD, BDT, DDT
- Analytical approach to problem-solving; excellent interpersonal and communication skills
- Experience in Data analysis & requirements validation
- Data-oriented personality. Motivated, independent, efficient, and able to work under pressure with a solid sense for setting priorities
- Experience in direct customer communications
- Skills in infrastructure troubleshooting, support in performance tuning and optimization, bottleneck problem analysis Understanding of CI/CD principles

TECHNOLOGIES
- Programming Languages: Python; Nice to have: Java, Scala, Bash, XPath
- SQL - MSSQL, PostgreSQL, MySQL, Oracle
- Big Data - Hadoop, HDFS, Hive, Spark, Kafka, Flume, Sqoop
- NoSQL - Cassandra, HBase, MongoDB
- Data Visualization: Tableau, Tibco Spotfire, Power BI
- ETL - MS SSIS, Talend, MicroStrategy
- Cloud - AWS/Azure/GCP - Storage; Compute; Networking; Identity and Security; Notebooks; Data Catalogs
- MDM tools
- Data Generation
- Test Management Tools: e.g. TestRail, Zephyr
- Performance Testing: e.g. JMeter
- CI/CD principles & tools (e.g. Jenkins)
- Queues and Stream processing
- ersion Control Systems (e.g. Git, SVN)

**BENEFITS**:

- ** Learning Culture** - We want you to be the best version of yourself, that is why we offer unlimited access to learning platforms, a wide range of internal courses, and all the knowledge you need to grow professionally
- ** Health Coverage** - Health and wellness are important, that is why we have you and up to four family members in a premiere health plan. We have a couple of options, so you can choose what is best for you and your family
- ** Visual Benefit** - Seeing your work for us would be a sight for sore eyes. We want your vision to always be at 100% which is why we offer up to $200.000 COP for any visual health expenses
- ** Life Insurance Plan** - We have partnered with MetLife to offer a full-coverage Ife insurance plan. So, your family is covered, even if you are gone
- ** Medical Leave Coverage** - We are one of the few companies that cover 100% of your medical leave, for up to 90 days. Your health is the most important thing to us
- ** Professional Growth Opportunities** - We have designed a highly competitive and complete development process, where you will have all the tools to get where you have always wanted to be, personally and professionally
- ** Stock Option Purchase Plan** - As an EPAMer you can be more than just an employee, you will also have the opportunity to purchase stock at a reduced price and become a part owner of our organization
- ** Additional Income** - Besides your regular salary, you will also have the chance to earn extra income by referring talent, being a technical interviewer, and many more ways
- ** Community Benefit** - You will be part of a **worldwide community of over 50,000 employees,** where you can learn, challenge yourself, stand out, and share your knowledge and experience with multicultural teams
- ** Are you open to relocation?** - If you want to relocate to another country and we have the right project, we will assist you every step of the way, to help you and your family, reach your new home

WE OFFER
- ** We trust our people**. We believe in team distribution and that you know what you are doing, which is why you will be able to work remotely and have a flexible schedule
- We are both proud of working within a diverse and inclusive environment and acting in our role as an equal opportunities’ employer. **You are welcome at EPAM for who you are**:

- ** You will be challenged while working side-by side with the best talent


  • Data Engineer

    hace 2 semanas


    Desde casa, Colombia TEAM International Services A tiempo completo

    Our client is a global professional services firm committed to delivering quality in assurance, advisory, and tax services. Financial Crime team works at the forefront of risk management, leveraging advanced technologies and analytics to combat financial crimes and safeguard our clients' interests. Data Pipeline Development: - Design and implement robust,...

  • Data Engineer

    hace 2 días


    Desde casa, Colombia Intellias A tiempo completo

    Project Overview: Our customer is a US based international company on the Fortune 500 list. They provide energy, logistics, and technology solutions to aviation, marine, and land customers and suppliers around the world. Their solutions include oil and energy procurement, distribution and storage, operations support, financial, consulting, and technology...

  • Ilatam Data Engineer

    hace 5 días


    Desde casa, Colombia Teleperformance A tiempo completo

    Overview: The Data Engineer is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. The Data Engineer will support our data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be...

  • Senior Data Engineer

    hace 1 semana


    Desde casa, Colombia Gorilla Logic A tiempo completo

    **Senior Data Engineer** **Responsibilities** - Design, build and maintain scalable and efficient data architectures, including databases, data warehouses, data lakes, data marts, and other storage solutions. - Design, build, and maintain robust data pipelines for the extraction, transformation, and loading (ETL) of data from various sources to storage and...

  • Data Engineer

    hace 15 horas


    Desde casa, Colombia Smart Talent IT A tiempo completo

    **Un cordial saludo, en Smart Talent tenemos una vacante denominada “Data Engineer” que te puede interesar a ti o a alguno de tus compañeros, así que no dejes de compartirla. 100% Trabajo remoto.** **Salario hasta COP $ 12.000.000 según conocimientos y experiência, la cual debe ser mínimo de 3 años.** **Perfil**: **Buscamos un Data Engineer para...

  • Senior Data Engineer

    hace 1 semana


    Desde casa, Colombia Gorilla Logic A tiempo completo

    **Senior Data Engineer** **Responsibilities** - Ability to understand ETL requirements and implement them - Work with DevOps and QA to build a quality focused CI/CD pipeline - Responsible for code reviews, testing and delivery of high-quality maintainable code - Work in an Agile environment to define, estimate and work user stories - Highly self-motivated,...

  • Senior Data Engineer

    hace 2 semanas


    Desde casa, Colombia Gorilla Logic A tiempo completo

    **Senior Data Engineer** Gorilla Logic is looking for a Senior Data Engineer. This is a unique and highly technical role responsible for data analysis within the enterprise. This role works with multiple data sources, data aggregation into data lakes, and data transformation into value. Our environment will require you to work effectively with your...

  • Senior Data Engineer

    hace 2 días


    Desde casa, Colombia Gorilla Logic A tiempo completo

    **Senior Data Engineer (Java/GCP)** **Responsibilities** - Design, build and maintain scalable and efficient data architectures, including databases, data warehouses, data lakes, data marts, and other storage solutions. - Design, build, and maintain robust data pipelines for the extraction, transformation, and loading (ETL) of data from various sources to...

  • Senior Data Engineer

    hace 2 días


    Desde casa, Colombia Gorilla Logic A tiempo completo

    **Senior Data Engineer (Java/GCP)** **Responsibilities** - Design, build and maintain scalable and efficient data architectures, including databases, data warehouses, data lakes, data marts, and other storage solutions. - Design, build, and maintain robust data pipelines for the extraction, transformation, and loading (ETL) of data from various sources to...

  • Senior Data Engineer

    hace 5 días


    Desde casa, Colombia Gorilla Logic A tiempo completo

    **Senior Data Engineer (Java)** Gorilla Logic is looking for a Senior Data Engineer, you will utilize your hand-on experience to design and develop reliable and scalable data solutions, working as a member of an Agile team responsible for building and maintaining our client's software as a service solution. Our environment will require you to work...