Job Summary
We are looking for a highly skilled and experienced Technical Lead (Sr. Data Engineer/Data Architect / Data Modeler) to join our team. will play a crucial role in designing data architecture and models based on business requirements, and ensuring data integrity, security, and performance. Oversee technical aspects of data integration and management and Provide technical guidance and support.
Key Responsibilities:
- Data Architecture and Design:
- Design and implement robust and scalable data pipelines and ETL processes.
- Develop and maintain data models and schemas that support business needs and analytics.
- Data Integration:
- Integrate data from various sources, including relational databases, data lakes, APIs, and third-party services.
- Ensure data consistency, accuracy, and reliability across all integrated systems.
- Data Pipeline Development:
- Build and optimize data pipelines for data ingestion, transformation, and storage.
- Implement data quality checks and validation processes to ensure data integrity.
- Performance Optimization:
- Monitor and optimize the performance of data pipelines and databases.
- Troubleshoot and resolve performance issues and data-related problems.
- Documentation and Reporting:
- Document data architecture, data pipelines, and processes.
- Provide regular reports and updates on project status and data infrastructure health.
- Continuous Improvement:
- Stay current with industry trends, emerging technologies, and best practices in data engineering.
- Propose and implement improvements to enhance data engineering practices and tools.
Qualifications:
- Bachelor’s degree in computer science
- 5-8 years of experience as a Data Engineer or in a similar role, with a strong focus on data architecture and pipeline development.
- Proficiency in programming languages such as Python, Java, or Scala, SQL, Spark
- Extensive experience with Cloudera & Big Data Technologies
- Familiarity with data processing frameworks and tools (e.g., Apache Spark, Apache Kafka, Hadoop).
- Knowledge of data warehousing solutions
- Strong problem-solving skills and the ability to work independently and as part of a team.
- Excellent communication skills and the ability to present complex technical information to non-technical stakeholders.
To apply for this job email your details to anup@praxisconsultants.in