Key Responsibilities
As a Data Engineer at Primeit, your primary responsibility is the end-to-end development and implementation of data pipelines. You will be responsible for source system acquisition, ensuring that raw data is ingested, processed, and refined into high-quality, usable assets within a medallion architecture.
Beyond coding, you will play a key role in the modernization of client platforms. This involves migrating legacy technologies to Databricks and potentially integrating GenAI components to streamline technology conversion. You will work closely with other Primers and client teams to ensure that data infrastructure is not only robust but also aligned with the evolving needs of the business.
Role Requirements & Qualifications
A competitive candidate for this position should demonstrate a solid track record in data engineering, particularly within cloud-native environments.
- Must-have skills:
- Proficiency in Databricks and Spark.
- Experience building and maintaining ETL pipelines.
- Strong English communication skills.
- Ability to work in a hybrid environment.
- Nice-to-have skills:
- Domain knowledge in the insurance or banking sectors.
- Experience with GenAI tools for code conversion or data transformation.
Frequently Asked Questions
Q: Is the technical challenge difficult?
A: The technical challenges are generally described as standard for the industry. If you have solid experience with Spark and ETL best practices, you should find them manageable.
Q: What is the culture like at Primeit?
A: Primeit emphasizes growth and continuous monitoring of performance. You will be part of a large, distributed team, so self-motivation and a proactive attitude are highly valued.
Q: How long does the process take?
A: The process typically spans three main stages, though this can vary depending on the client’s timeline. Expect clear communication from the business manager throughout.
Q: Do I need to be a senior to apply?
A: The role is open to both Mid-Level and Senior engineers. Focus your preparation on highlighting the complexity and scale of the projects you have successfully delivered.
Other General Tips
- Prepare your "Consultant Pitch": Be ready to explain your projects by focusing on the business problem solved, the technology used, and the measurable impact on the client.
- Master the Spark Basics: Since Spark tests are common, review common pitfalls like data skew and memory management.
- Research the Industry: If you are interviewing for a role in banking or insurance, brush up on the typical data challenges those industries face, such as regulatory compliance and high-volume transaction processing.
- Be Transparent about Experience: If you lack specific experience in GenAI, focus on your ability to learn new tools quickly, which is a core skill for any consultant.