Quinnox
Solutions Architect - Dataiku
Get notified of more jobs like this · No spam, ever
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
Solution Architect, Dataiku Applications & Integrations
Position Summary
We are seeking an experienced Solution Architect with Dataiku application and integration expertise to lead the architecture and technical design of a modern Independent Price Verification (IPV) platform supporting a global Refined Product Trading organization.
The Solution Architect will define the end-to-end architecture for a governed, metadata-driven IPV Control Hub that replaces fragmented Excel, Microsoft Access, VBA, and email-based processes with an automated, controlled, and SOX-compliant enterprise solution.
The platform will use Dataiku for data ingestion, transformation, business-rule execution, historical replay, and application development; Dataiku WebApps for human-in-the-loop business processes; Power Automate for workflow orchestration; PostgreSQL and Amazon RDS for governed data storage; and Power BI for operational, risk, and management reporting.
The successful candidate will work closely with Commodity Risk, Trading, Finance, Data Engineering, Cybersecurity, Platform, Architecture, Compliance, and business stakeholders. This individual will ensure the solution is scalable, secure, auditable, supportable, and aligned with enterprise architecture standards.
Key Responsibilities
Solution Architecture and Technical Leadership
- Define and maintain the end-to-end solution architecture for the IPV Control Hub across data acquisition, processing, workflow, storage, reporting, security, and governance layers.
- Translate business, risk, audit, security, and regulatory requirements into scalable technical architecture and solution designs.
- Establish the architectural standards, integration principles, reusable patterns, and technical guardrails for the platform.
- Create solution architecture diagrams, data-flow diagrams, integration designs, interface specifications, security models, and deployment views.
- Provide technical leadership throughout design, development, testing, deployment, transition, and production stabilization.
- Evaluate design alternatives and recommend solutions based on scalability, auditability, resiliency, security, maintainability, and operational support requirements.
- Ensure clear separation of responsibilities across Dataiku, Power Automate, PostgreSQL or Amazon RDS, Power BI, and connected enterprise systems.
- Facilitate architecture reviews, technical design workshops, and solution walkthroughs with business and technology stakeholders.
- Identify architectural dependencies, design risks, integration constraints, and nonfunctional requirements early in the delivery lifecycle.
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
Dataiku Architecture
- Define the Dataiku architecture supporting ingestion, data preparation, transformation, business-rule processing, consensus pricing, variance calculation, threshold evaluation, historical replay, and exception management.
- Establish standards for Dataiku projects, Flows, datasets, managed folders, recipes, scenarios, plugins, APIs, applications, and reusable components.
- Design scalable Dataiku processing frameworks that support more than 70 internal and external data sources, including structured and unstructured data.
- Define metadata-driven frameworks for managing brokers, source priorities, mappings, thresholds, currencies, units of measure, regional variations, approval paths, and business rules.
- Design reusable Dataiku project templates and onboarding patterns for new brokers, market-data providers, commodities, regions, and business processes.
- Establish Dataiku development, testing, production, version-control, promotion, deployment, and rollback standards.
- Define monitoring, alerting, failure handling, restart, recovery, and operational support patterns for Dataiku processes.
- Ensure Dataiku processing is deterministic, traceable, version-controlled, and capable of reproducing historical IPV runs.
- Guide the migration of legacy Microsoft Access queries, Excel formulas, macros, and VBA logic into controlled Dataiku processing frameworks.
- Partner with Dataiku engineers and developers to review application designs, integration components, Python code, SQL logic, reusable recipes, and deployment configurations.
Delivery and Stakeholder Collaboration
- Serve as the primary architecture liaison across Commodity Risk, Trading, Finance, Technology, Security, Compliance, Audit, and delivery teams.
- Convert business processes and control requirements into detailed technical designs and implementation roadmaps.
- Work with product owners and business analysts to refine architecture epics, features, technical stories, and acceptance criteria.
- Partner with Dataiku engineers, integration developers, database engineers, Power BI developers, testers, DevOps teams, and platform administrators.
- Participate in Agile ceremonies, sprint planning, backlog refinement, solution demonstrations, and release-readiness reviews.
- Review technical deliverables to ensure alignment with approved architecture.
- Support testing strategy, including system integration testing, regression testing, performance testing, security testing, user acceptance testing, and control validation.
- Provide architecture support during deployment, production transition, stabilization, and operational handover.
- Develop technical documentation and knowledge-transfer materials for engineering and production-support teams.
Get help with your application
Your very own career expert that helps elevate your application to the next level.
Required Qualifications
- Bachelor’s degree in Computer Science, Information Systems, Engineering, Data Science, or a related field.
- Significant experience in solution architecture, data architecture, application architecture, or enterprise integration architecture.
- Hands-on experience designing enterprise solutions using Dataiku DSS.
- Experience architecting or developing Dataiku applications and WebApps.
- Strong understanding of Dataiku Flows, recipes, datasets, managed folders, scenarios, plugins, APIs, automation, and deployment processes.
- Experience designing metadata-driven and configuration-driven data-processing platforms.
- Strong knowledge of Python and SQL-based data solutions.
- Experience integrating Dataiku with databases, APIs, file systems, enterprise applications, workflow platforms, and reporting tools.
- Experience with PostgreSQL, Amazon RDS, or comparable relational database platforms.
- Experience defining REST API, database, batch-file, XML, and event-based integration patterns.
- Understanding of cloud and on-premises integration architectures.
- Experience designing solutions with data lineage, traceability, audit logging, version control, role-based access, and evidence retention.
- Experience translating business and regulatory requirements into solution architecture and technical designs.
- Experience working in Agile delivery environments and leading architecture across multidisciplinary teams.
- Strong written and verbal communication skills, including the ability to present complex technical designs to business and executive stakeholders.
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Skills
Location