Job Description
For additional information, please review .**Responsibilities:*** Operate end-to-end in the design, development, and implementation of robust big data solutions, ensuring optimal performance, scalability, data quality, and security.* Collaborate closely within small, co-located squads (4-7 person teams), fostering high communication and low coordination overhead, to translate complex business requirements into technical specifications for big data processing and analytical solutions.* Act as a player/coach within the team, mentoring junior members and leading by example in the development of efficient and innovative big data architectures.* Design, develop, and optimize large-scale data pipelines using PySpark for data ingestion, transformation, and aggregation, always with an eye towards efficiency and domain relevance.* Implement and manage real-time data streaming and event-driven architectures using technologies like Apache Kafka.* Design and implement sophisticated data warehousin...