Big Data Engineer with Python

Kraków
PL37637

For one of our clients, IT company entering Polish market and building brand new technology center in Cracow, we are looking for Big Data Engineer with Python to support their international customers.

Company overview:

HQ in USA- New York, office in India - Bangalore, opening new office in Poland - Cracow,
Providing end to end cloud solutions for retail an e-commerce industry working with multiple Fortune 500 companies and some of the world’s best startups,
Scope of services includes: Enterprise Assessment & Adoption, Cloud Devops & Support Cloud Application Re-engineering, Research innovation, Data Science, Machine Learning, Artificial Intelligence, UX Design.

Key functions:

Design, develop and maintain big data software pipelines,
Being involved in team discussions about projects that requires data science and machine learning computation,
Developing complex data workflows based on data integration between Kafka, Apache Spark, HBase and other similar systems,
Solve and enhance bottlenecks in the software stack by devising scalable distributed solution between different internal data centers and various cloud providers (like Google and AWS).

Requirements:

Extensive experience programming in Java or equivalent Object-Oriented language,
Hands on experience in building and optimizing ‘big data’ data pipelines, architectures and data sets,
Senior level knowledge of big data tools: Kafka, HBase, Hadoop, Spark, etc.,
Experience with RabbitMQ, ActiveMQ, and ZeroMQ Message Brokers,
Practical experience with SQL and NoSQL,
Strongly self-motivated and self-driven, a good team player.

Nice to have:

Spark knowledge, with a specific focus on optimization, data manipulation (rdd, spark SQL` queries) and persistence (hdfs, parquet, HBase)
Familiarity with Agile development methodology preferably Scrum

Aplikuj

Big Data Engineer with Python

Oferty wybrane dla Ciebie