We are looking for an experienced Data Engineer -OCI Data Lakehouse (DLH) to join our Data Management Office and support enterprise-scale Oracle Cloud Infrastructure (OCI) Data Engineering and Data Lakehouse projects.
The ideal candidate will have strong hands-on experience in OCI Data Flow, Apache Spark, Oracle Autonomous Data Warehouse (ADW), OCI Object Storage, Oracle Data Integrator (ODI), Python, SQL, and Delta Lakehouse architecture.
The role will involve designing and developing scalable data pipelines, data ingestion frameworks, analytical datasets, and data products supporting business analytics, regulatory reporting, and AI/ML initiatives.
Key Responsibilities
- Design, develop, and maintain scalable OCI data pipelines for data ingestion, transformation, and processing.
- Build ETL/ELT workflows using OCI Data Flow, Apache Spark, ODI, and AIDP.
- Implement Data Lakehouse and Delta Lake architectures, including ingestion, curation, and consumption layers.
- Develop and optimize analytical datasets, data marts, and data models on Oracle Autonomous Data Warehouse (ADW).
- Manage structured and unstructured data within OCI Object Storage.
- Develop reusable data ingestion and transformation frameworks.
- Implement data quality, metadata, lineage, governance, and validation controls.
- Optimize SQL queries, Spark jobs, ETL processes, and ADW workloads.
- Identify and resolve data pipeline, performance, and processing bottlenecks.
- Work closely with business and technology stakeholders to convert requirements into scalable data solutions.
- Support data products for analytics, reporting, regulatory requirements, and AI/ML use cases.
Required Skills & Experience
OCI & Oracle Technologies
- Strong hands-on experience with Oracle Cloud Infrastructure (OCI).
- OCI Data Flow / Apache Spark
- Oracle Autonomous Data Warehouse (ADW)
- OCI Object Storage
- Oracle Data Integrator (ODI)
- Oracle AI Data Platform (AIDP)
Data Engineering
- 7+ years of relevant Data Engineering experience.
- Strong proficiency in SQL and Python.
- Experience developing enterprise-scale ETL/ELT pipelines.
- Strong knowledge of data ingestion, transformation, orchestration, and processing.
- Experience with Apache Spark / PySpark.
- Experience with Delta Lakehouse and modern data engineering practices.
- Understanding of Medallion Architecture and data layering.
- Experience with data performance tuning and troubleshooting.
Preferred Skills
- Oracle GoldenGate
- Real-time data replication and Change Data Capture (CDC)
- Data governance and metadata management
- Data lineage and data quality frameworks
- Data observability
- AI/ML data preparation and feature engineering
- Experience with enterprise cloud data platforms
Domain Experience
Experience in the Insurance industry is preferred but not mandatory.
Exposure to any of the following areas will be an advantage:
- Policy Administration
- Claims Management
- Underwriting
- Finance
- Regulatory Reporting
Key Performance Targets
The successful candidate will be expected to:
- Build reliable and scalable OCI data pipelines.
- Improve data processing performance and platform efficiency.
- Develop reusable ingestion and transformation frameworks.
- Deliver trusted, high-quality analytical datasets.
- Support timely delivery of business and regulatory data requirements.
- Improve data availability for analytics and AI/ML initiatives.
- Maintain strong data quality, lineage, governance, and operational reliability.
Ideal Candidate
We are specifically targeting hands-on Data Engineers with strong experience in:
OCI + Data Flow + Spark/PySpark + Python + SQL + ADW + ODI + Delta Lakehouse
This is a Data Engineering / Data Lakehouse role, not an Oracle DBA or general OCI Infrastructure Administrator position.
To apply for this job email your details to anup@praxisconsultants.in