Data Architect Job at VDart Inc, Remote

Sk1HY09vZG1nSENhR0JSMTVMLzZ0TmthWVE9PQ==
  • VDart Inc
  • Remote

Job Description

Role : Data Architect

Experience : 12-14 Years of relevant experience in big data, Databricks engineer, Sr. data lead.

Mode: Contract

Location: Mississauga, Canada

Job Description :

As a Data Architect (Custody Domain), you will design and lead the implementation of a high-performance, event-driven data ecosystem. You will serve as the technical authority on the Cloudera Data Platform (CDP), with a heavy focus on Kafka-based streaming and Cloud-native architectures. Your role is to bridge real-time data flows from custody operations-such as trade settlements and cash movements-into resilient microservices, data pipelines, and data marts across hybrid and multi-cloud environments.

Key Responsibilities:

Event-Driven Architecture: Architect enterprise-grade streaming solutions using Apache Kafka as the central event bus to decouple producers and consumers across the custody lifecycle.

Cloud Strategy & Migration: Design and oversee the deployment of data workloads across Public, Private, and Hybrid Cloud environments, ensuring high availability, disaster recovery, and cost-optimization.

Real-Time Processing: Build and tune Apache Flink and Spark Streaming jobs to process Kafka streams for real-time fraud detection, automated regulatory reporting, and continuous transaction monitoring.

Data Ingestion & Orchestration: Design scalable, automated ingestion frameworks to move data from legacy custody systems into the CDP ecosystem, ensuring data integrity and low-latency delivery.

Microservices Strategy: Lead the design of data-centric microservices that interact with Kafka for event sourcing and asynchronous communication in a containerized cloud environment.

Data Mart Design: Develop performant data marts and reporting layers that provide actionable insights to business stakeholders and regulatory bodies using CDP's modern warehouse engines.

Security & Governance: Implement centralized security and governance through Cloudera SDX, ensuring strict compliance with financial regulations across all cloud storage and compute layers.

Technical Qualifications:

Cloudera Mastery: Expert-level knowledge of the Cloudera Data Platform (CDP) stack and its integration within cloud-native infrastructures.

Kafka Expertise: Advanced skills in Kafka cluster planning, topic management, partitioning strategies, and performance tuning (e.g., exactly-once delivery, back-pressure handling).

Cloud Proficiency: Deep experience in architecting data solutions on major Cloud Service Providers, focusing on managed compute, object storage, and networking security.

Stream Processing Engines: Strong proficiency in Apache Spark (Streaming/Batch) and working knowledge of Apache Flink.

Infrastructure as Code: Familiarity with containerization (Docker/Kubernetes) and automated deployment tools to manage data services at scale.

Job Tags

Contract work

Similar Jobs

Serenity Mental Health Centers

Physician Recruiter Job at Serenity Mental Health Centers

 ...The Role: Physician Recruiter|Las Colinas, TX As a Physician Recruiter at Serenity Healthcare,youlllead the full recruitment process-sourcing,screeningandhiringtop clinical talent.Your workensureswe continue to build strong, patient-focused teams across... 

Intuit

Director, Security Incident Response Job at Intuit

 ...Overview You will lead the organization responsible for security incident response, bringing together monitoring, detection engineering,...  ...and technique-level checks. Oversee penetration testing management, including coverage planning, vendor governance, retesting,... 

NVE Pharmaceuticals

Warehouse Staff Job at NVE Pharmaceuticals

 ...team player attitude but able to work independently. Be able to prioritize job functions. Be able to operate a forklift, electric pallet jack, or hand jack. Possess strong communication skills and the ability to follow both written and verbal instructions.... 

Blain's Farm & Fleet

Automotive Service Advisor Job at Blain's Farm & Fleet

 ...Compensation Saturday & Sunday weekend premium pay $2.50 per hour Base pay up to $17.75/hr The pay listed for this position may...  ...for accurate pay range information. Job Duties The Service Advisor will perform automotive services in a timely and... 

Baylor College of Medicine

Physician, Radiation Oncology (Assistant, Associate, or Full Professor) Job at Baylor College of Medicine

 ...Summary The Department of Radiation Oncology at Baylor College of Medicine in Houston, TX is recruiting for a position at the Assistant, Associate, or Full Professor level. Physicians are anticipated to take part in all facets of the clinical care, research, and educational...