Senior Principal Consultant - Data Architect

Job Description

Data Architect – Databricks (Azure/AWS)

Role Overview:

We are seeking an experienced Data Architect specializing in Databricks to lead the architecture, design, and migration of enterprise data workloads from on-premises systems (e.g., Oracle, Exadata, Hadoop) to Databricks on Azure or AWS. The role involves designing scalable, secure, and high-performing data platforms based on the medallion architecture (bronze, silver, gold layers), supporting large-scale ingestion, transformation, and publishing of data.

Required Skills and Experience:

• 8+ years of experience in data architecture or engineering roles, with at least 3+ years specializing in cloud-based big data solutions.
• Hands-on expertise with Databricks on Azure or AWS.
• Deep understanding of Delta Lake, medallion architecture (bronze/silver/gold zones), and data governance tools (e.g., Unity Catalog, Purview).
• Strong experience migrating large datasets and batch/streaming pipelines from on-prem to Databricks.
• Expertise with Spark (PySpark/Scala) at scale and optimizing Spark jobs.
• Familiarity with ingestion from RDBMS (Oracle, SQL Server) and legacy Hadoop ecosystems.
• Proficiency in orchestration tools (Databricks Workflows, Airflow, Azure Data Factory, AWS Glue Workflows).
• Strong understanding of cloud-native services for storage, compute, security, and networking.
  
  
  

Preferred Qualifications:

• Databricks Certified Data Engineer or Architect.
• Azure/AWS cloud certifications.
• Experience with real-time/streaming ingestion (Kafka, Event Hubs, Kinesis).
• Familiarity with data quality frameworks (e.g., Deequ, Great Expectations).
  
  
  

Responsibilities

Key Responsibilities:

• Define and design cloud-native data architecture on Databricks using Delta Lake, Unity Catalog, and related services.
• Develop migration strategies for moving on-premises data workloads (Oracle, Hadoop, Exadata, etc.) to Databricks on Azure/AWS.
• Architect and oversee data pipelines supporting ingestion, curation, transformation, and analytics in a multi-layered (bronze/silver/gold) model.
• Lead data modeling, schema design, performance optimization, and data governance best practices.
• Collaborate with data engineering, platform, and security teams to build production-ready solutions.
• Create standards for ingestion frameworks, job orchestration (e.g., workflows, Airflow), and data quality validation.
• Support cost optimization, scalability design, and operational monitoring frameworks.
• Guide and mentor engineering teams during the build and migration phases.
  
  
  

Attributes for Success:

• Ability to lead architecture discussions with technical and business stakeholders.
• Passion for modern cloud data architectures and continuous learning.
• Pragmatic and solution-driven approach to migrations.
  
  
  

Diversity and Inclusion: An Oracle career can span industries, roles, Countries, and cultures, allowing you to flourish in new roles and innovate while blending work life in. Oracle has thrived through 40+ years of change by innovating and operating with integrity while delivering for the top companies in almost every industry. To nurture the talent that makes this happen, we are committed to an inclusive culture that celebrates and values diverse insights and perspectives, a workforce that inspires thought leadership and innovation. Oracle offers a highly competitive suite of Employee Benefits designed on the principles of parity, consistency, and affordability. The overall package includes certain core elements such as Medical, Life Insurance, access to Retirement Planning, and much more. We also encourage our employees to engage in the culture of giving back to the communities where we live and do business. At Oracle, we believe that innovation starts with diversity and inclusion and to create the future we need talent from various backgrounds, perspectives, and abilities. We ensure that individuals with disabilities are provided reasonable accommodation to successfully participate in the job application, and interview process, and in potential roles. To perform crucial job functions. That’s why we’re committed to creating a workforce where all individuals can do their best work. It’s when everyone’s voice is heard and valued that we’re inspired to go beyond what’s been done before.

About Us

As a world leader in cloud solutions, Oracle uses tomorrow’s technology to tackle today’s challenges. We’ve partnered with industry-leaders in almost every sector—and continue to thrive after 40+ years of change by operating with integrity.

We know that true innovation starts when everyone is empowered to contribute. That’s why we’re committed to growing an inclusive workforce that promotes opportunities for all.

Oracle careers open the door to global opportunities where work-life balance flourishes. We offer competitive benefits based on parity and consistency and support our people with flexible medical, life insurance, and retirement options. We also encourage employees to give back to their communities through our volunteer programs.

We’re committed to including people with disabilities at all stages of the employment process. If you require accessibility assistance or accommodation for a disability at any point, let us know by emailing [email protected] or by calling +1 888 404 2494 in the United States.

Oracle is an Equal Employment Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability and protected veterans’ status, or any other characteristic protected by law. Oracle will consider for employment qualified applicants with arrest and conviction records pursuant to applicable law.