What you need to succeed:

• 3+ years as a Lead/Chief Architect working on enterprise software on a distributed platform.

• Proficiency in spark, MLlib and spark internals and able to extend spark code base for analytical needs.

• Required: Proficiency in data structures and algorithms in Scala/Java

• Recognized Subject-Matter Expert big data engineering and cloud-based data warehouse.

• In depth experience with No-SQL as well as RDBMS/Data warehouse, data sharing and federation

• Plus, to be a Committer or PMC Member with the Apache Software Foundation on big data technologies: Apache Spark, Hadoop Stack, Kafka, Comet, Atlas, delta

• Cost consciousness around computation and memory requirements

• Strong verbal and written communication skills

• Bachelor's Degree in Computer Science with 10 years experiences or Master/Ph.D Degree in Compute Science or relevant field with 6+ year experiences.

• Plus: LLM/vertical LLM for improving in product intelligence (sql rewriting, anomalies, forecasting and more)

What you’ll do

• Own the technical design, vision and implementation strategy for major systems & components of the Adobe Experience Cloud data platform mainly focused on distributed Query Service.

• Build/code/test and own critical parts of the services to run at scale.

• Ability to articulate the design and code choices to multi-functional and architecture teams.

• Reviewing and providing feedback on features, technology, architecture, designs, and test strategies

• Mitigating risks & creative problem solving

• Developing and evolving engineering to optimize team efficiency.

• Partner with other teams across Adobe for achieving common goals.

Our compensation reflects the cost of labor across several  U.S. geographic markets, and we pay differently based on those defined markets. The U.S. pay range for this position is $154,000 -- $278,800 annually. Pay within this range varies by work location and may also depend on job-related knowledge, skills, and experience. Your recruiter can share more about the specific salary range for the job location during the hiring process.