DATA ENGINEER

Job Summary:
We are seeking an experienced Data Engineer to join our dynamic IT team. As a Data Engineer, you will be responsible for designing, developing, and maintaining robust data architectures and pipelines. The ideal candidate should have 3 to 5 years of relevant experience, a strong background in data engineering technologies, and a passion for optimizing data workflows.

Responsibilities:

• Collaborate with cross-functional IT teams to understand data requirements and architecture goals.
• Design and develop scalable and efficient data pipelines for data processing and integration.
• Implement ETL processes to transform raw data into usable formats for analysis and reporting.
• Optimize and maintain database performance, ensuring data integrity and reliability.
• Collaborate with data scientists and analysts to understand data needs and provide efficient solutions.
• Design and implement data models, ensuring compatibility with business requirements.
• Develop and maintain documentation for data engineering processes, workflows, and data dictionaries.
• Collaborate with IT security teams to implement data privacy and compliance measures.
• Stay updated on emerging trends and best practices in data engineering.
• Participate in the planning and execution of data-related projects.

Requirements:

• Bachelor's degree in computer science, Information Technology, or a related field.
• 3 to 5 years of proven experience as a Data Engineer.
• Proficiency in programming languages for data manipulation and transformation (e.g., Python, Scala).
• Experience with data warehousing solutions (e.g., Snowflake, Redshift, BigQuery).
• Strong knowledge of ETL tools and frameworks (e.g., Apache Spark, Apache Beam).
• Proficient in SQL and database management (e.g., MySQL, PostgreSQL, or similar).
• Familiarity with cloud-based data storage and processing platforms (e.g., AWS, Azure, or Google Cloud).
• Excellent problem-solving and debugging skills.
• Ability to collaborate effectively with cross-functional teams and communicate technical concepts to non-technical stakeholders.
• Proactive attitude towards learning and staying updated on industry trends.

Preferred Qualifications:

• Master's degree in computer science or a related field.
• Certification in data engineering or related areas.
• Experience with real-time data processing and streaming technologies.
• Knowledge of data governance and compliance.
• Familiarity with machine learning concepts and implementations.
• Contribution to open-source data engineering projects or a strong portfolio of previous work.