Specialist Data Streaming Engineer

**Specialist Data Streaming Engineer**
- This position is expected to be a Senior Technical Expert in a large data, fast-paced environment. Heavy emphasis on Data pipelines and streaming technologies such as Kafka/Event Hubs.
- Cloud experience is a must.
- The ability to mentor other team members and pass on knowledge during and after development projects/tasks is required.
- This position will also be expected to keep up with current technologies and methods. Feedback is expected if better methods or technologies could improve our processes.
- The ability to gain a fundamental understanding of the nature, purpose, and meaning of the data is crucial.
- The Senior Technical Expert must be able to research and decipher any format of data provided via acquisition.
- This role will need to manage any data processes and respond to any issues in the processes. Participation in an on-call (non-working hours) support rotation will be expected.
- Attention to resource utilization (space, CPU, memory, network) will be expected.
- This role will need to effectively communicate with team members, other teams, other business units, and leadership.

Are you the next **Specialist Data Engineer** we are looking for?
- Kafka/Event Hubs, NoSQL DB platforms, SQL development, Database development, Python Development, ETL development, Oracle, JSON, Unix scripting, MDM
- Additional, but not required skills, MySQL, Kubernetes, DRUID, Airflow, Databricks, Couchbase, Stambia, Azure, and Agile.

**In this role you’ll**:

- Data engineer and data modeling architecture knowledge of analytics platforms. This includes experience with large-scale ETL/ELT, denormalization and schema knowledge, and tuning of data ingest pipelines. Research and implement cutting-edge solutions to solve challenges related to ETL/ELT, data processing, and analytics. Large-scale ingestion, lambda architectures, etc.
- Mentor members of the team as well as other leads.
- Build, maintain, and monitor ETL Processes, data pipeline processes, and streaming processes.
- Tune queries and processes for reporting
- Analyze Data for issues, corruption, or inaccuracies
- Adapt and learn new data platforms and ways to process data
- Bachelor’s or master’s degree in Computer Science or Software Engineering or related
- 7+ years of experience in software development experience
- Technical Competencies: Apache Kafka is a must (2 years)

Python or a strong scripting equivalent is a must
Apache Airflow data pipelines and data transformation
Unix and shell scripting is a must
Strong SQL skills are a must
Good grasp of data modeling
Experience moving, receiving, sharing, and reformatting data across systems
Experience working with real-time streaming or event systems (such as Kafka or Event Hubs)

**Preferred Qualifications**:

- Knowledge of professional software engineering practices & best practices for the full software development life cycle including coding standards, code reviews, source control management, build processes, testing, and operations.
- **Docker/Kubernetes/Helm. GIT.** Working experience on CI/CD using Jenkins. Automating data engineering Kubernetes deployments. Strong knowledge of Jenkins pipelines. Automating docker image creations. Keep data engineering tools and technologies upgraded without downtime.
- **Groovy** scripting knowledge.
- Data model experience for Data warehousing using modern standards dimensional modeling, **Druid, and Spark**.
- Big Data Analytics (**Hive, Hadoop**)

**Knowledge, Skills, and Abilities**:

- Ability to communicate effectively, both verbally and in writing.
- Strong organizational skills with a high attention to detail.
- Ability to analyse objectives, considers options and plans.
- Data Analysis, Transformation, Data pipelines and data streaming.

**What we can offer you**:

- The opportunity to work for one of the world’s top leading travel tech companies; a company that originated in technology innovation and sees the world with a technology-first perspective
- Skills development and opportunities to try new ideas
- A global diverse work environment

**Salary**: Up to $15,000,000 per month