Data Architect Job at VDart Inc, Remote

Sk1HY09vZG1nSENhR0JSMTVMLzZ0TmthWVE9PQ==
  • VDart Inc
  • Remote

Job Description

Role : Data Architect

Experience : 12-14 Years of relevant experience in big data, Databricks engineer, Sr. data lead.

Mode: Contract

Location: Mississauga, Canada

Job Description :

As a Data Architect (Custody Domain), you will design and lead the implementation of a high-performance, event-driven data ecosystem. You will serve as the technical authority on the Cloudera Data Platform (CDP), with a heavy focus on Kafka-based streaming and Cloud-native architectures. Your role is to bridge real-time data flows from custody operations-such as trade settlements and cash movements-into resilient microservices, data pipelines, and data marts across hybrid and multi-cloud environments.

Key Responsibilities:

Event-Driven Architecture: Architect enterprise-grade streaming solutions using Apache Kafka as the central event bus to decouple producers and consumers across the custody lifecycle.

Cloud Strategy & Migration: Design and oversee the deployment of data workloads across Public, Private, and Hybrid Cloud environments, ensuring high availability, disaster recovery, and cost-optimization.

Real-Time Processing: Build and tune Apache Flink and Spark Streaming jobs to process Kafka streams for real-time fraud detection, automated regulatory reporting, and continuous transaction monitoring.

Data Ingestion & Orchestration: Design scalable, automated ingestion frameworks to move data from legacy custody systems into the CDP ecosystem, ensuring data integrity and low-latency delivery.

Microservices Strategy: Lead the design of data-centric microservices that interact with Kafka for event sourcing and asynchronous communication in a containerized cloud environment.

Data Mart Design: Develop performant data marts and reporting layers that provide actionable insights to business stakeholders and regulatory bodies using CDP's modern warehouse engines.

Security & Governance: Implement centralized security and governance through Cloudera SDX, ensuring strict compliance with financial regulations across all cloud storage and compute layers.

Technical Qualifications:

Cloudera Mastery: Expert-level knowledge of the Cloudera Data Platform (CDP) stack and its integration within cloud-native infrastructures.

Kafka Expertise: Advanced skills in Kafka cluster planning, topic management, partitioning strategies, and performance tuning (e.g., exactly-once delivery, back-pressure handling).

Cloud Proficiency: Deep experience in architecting data solutions on major Cloud Service Providers, focusing on managed compute, object storage, and networking security.

Stream Processing Engines: Strong proficiency in Apache Spark (Streaming/Batch) and working knowledge of Apache Flink.

Infrastructure as Code: Familiarity with containerization (Docker/Kubernetes) and automated deployment tools to manage data services at scale.

Job Tags

Contract work

Similar Jobs

The Goddard School

Chinese Teacher: Part Time Job at The Goddard School

The Goddard School of Bethesda is looking for an energetic, warm, and engaging Part Time Chinese Language teacher.A Chinese Teacher at The Goddard School is responsible for establishing and maintaining a safe, healthy and nurturing learning environment. Additionally... 

Repligen

Executive Assistant Job at Repligen

The Executive Assistant provides high-level administrative and operational support to multiple senior leaders, enabling executives to operate efficiently and focus on strategic priorities. This role requires exceptional organizational skills, strong judgment, discretion... 

Skilled Trades Services

CDL A Job at Skilled Trades Services

 ...for the delivery of raw material to bakeries, grocery stores and donut shops. Trucks have lift gates and drivers will utilize electric pallet jacks and 2 wheelers to unload product. Regional routes can vary between 500 to 1500 mile Responsibilities: Safely operate a... 

Lehrer Family Chiropractic

Remote Registered Nurse Job at Lehrer Family Chiropractic

 ..., remote Position: Remote Registered Nurse Company: Lehrer Family Chiropractic Location: Melville...  ...that offers the flexibility to work from your own home while still making a positive impact on the health and well-being of our patients. As a Remote Registered... 

Schoolforce Solutions Inc

Speech Language Pathologist Job at Schoolforce Solutions Inc

 ...We are looking for a talented Speech Language Pathologist (SLP) to join our team for the school year. Hourly Rate Range : $48.00-$61...  ...Required Qualifications: Master's Degree in Speech-Language Pathology from an accredited program. Colorado Department of...