Data Engineer

Make an impact by working for sectors where technology is the enabler, everything is ground-breaking and there’s a constant need to be innovative.

Create and enhance projects in Java, Python, Angular, PHP, .NET and so much more while diving in the world of Blockchain, Artificial Intelligence, Data Science, Security and Internet of Things.

Be part of the team that combines business knowledge, technological edge and a design experience. Our different backgrounds and know-how are key in developing solutions and experiences for digital clients.

Face challenges and learn other ways of thinking and seeing the world - there’s always room for your energy and creativity.

About the role

Data Engineer is responsible for building and maintaining Data Platforms. Recognizes the importance of data for the organization in the areas where it is the key to success. Maintaining an eye on the big picture and knowing the details of the business are decisive for this role.

This role is focused on designing, developing, and maintaining the data platform required for data storage, processing, orchestration, and analysis.

The mission involves implementing scalable and performant data pipelines and data integration solutions.

Agnostic of data sources and technologies to ensure efficient data flow and high data quality, enabling data scientists, analysts, and other stakeholders to access and analyze data effectively.

As a part of your job, you will:

• Design, build, and maintain scalable data platforms

• Collect, process, and analyze large and complex data sets from various sources

• Develop and implement data processing workflows using data processing framework technologies

• Collaborate with cross-functional teams to ensure data accuracy and integrity

• Ensure data security and privacy through the proper implementation of access controls and data encryption

• Extraction of data from various sources, including databases, file systems, and APIs

• Monitor system performance and optimize for high availability and scalability

What are we looking for?

• BSc or MSc in Computer Engineering or IT-related courses;

• 5+ Years of Data Engineering experience;

• Experience with at least one programming language in the context of Data Engineering, such as Java, Scala, or Python;

• Experience working with at least one event streaming platform such as Kafka, Pulsar, or similar Cloud services such as Amazon Kinesis Data Streams, Amazon MSK (Kafka), GCP Pub/Sub, or Azure Event Hubs.

• Experience with at least one stream processing framework, such as Apache Kafka Streams, Apache Flink, Apache Spark Streaming or Apache Storm, or similar Cloud data processing frameworks such as GCP Dataflow or Amazon Kinesis Data Analytics.

• Experience working with at least one modern data integration and movement framework suitable for streaming data sources, such as Apache NiFi, Streamsets, Kafka Connect, GCP Data Fusion, and Amazon Firehose

Nice to have:

• Experience with Docker, Kubernetes, and Helm;

• Experience with CI/CD tools such as Jenkins, Nexus, Sonarqube, etc;

• Experience with Datalakes, Lakehouses, MPP Engines such as Presto, Dremio, Drill, Impala, Hive, Amazon Athena, GCP BigQuery, Databricks;

• Experience working in Cloud Environments (I.e, AWS, GCP, Azure);

• General knowledge of agile methodologies such as Scrum, Kanban, etc;

• Experience working with NoSQL Databases such as Key-Value stores, Document DBs, Time-series DBs, or Graph DBs;

• Experience with Data Warehouse (Data Modelling, ETL, and BI tooling);

• Knowledge with Apache Druid (data modelling, real-time ingestion, and efficient query patterns);

• Knowledge of code instrumentation, APM, Prometheus, and Grafana.

Personal traits

• Ability to adapt to different contexts, teams, and Clients;

• Teamwork skills but also a sense of autonomy;

• Motivation for international projects and ok if travel is included;

• Willingness to collaborate with other players;

• Strong communication skills.
  

At Celfocus, we are committed to cultivate a diverse and inclusive workplace. As an equal-opportunity employer, we welcome applicants of all backgrounds, gender identities, and abilities. We are dedicated to providing reasonable accommodations for candidates with specific needs. If you require any adjustments during the selection process, please inform our Talent Acquisition Team.

Come join the Team!