Job Description
Job Title: Senior Databricks Data Engineer
About VLink: Started in 2006 and headquartered in Connecticut, VLink is one of the fastest
growing digital technology services and consulting companies. Since its inception, our innovative
team members have been solving the most complex business, and IT challenges of our global
clients.
Job Description:
Real-Time & Batch Integration: Configure and manage continuous data ingestion pipelines using Apache Kafka event streams for real-time market data, alongside scheduled batch processing of Parquet files and Delta Lake tables.
Medallion Data Modeling: Architect and implement Databricks Lakehouse data models (Bronze/Silver/Gold layers) tailored for energy commodities, ensuring high performance, data lineage, scalability, and compute efficiency.
Cross-Desk Reporting Delivery: Collaborate with Front, Middle, and Back Office stakeholders to transform raw transaction...