The Streaming Data Platform team builds and operates large-scale, real-time stream processing systems using modern open-source technologies. We design pipelines that power analytics, reporting, and downstream product use cases by delivering high-quality data with low latency and high reliability. We’re looking for a Senior Software Engineer to help design, build, and operate streaming data pipelines and storage systems that support near real-time analytics and diverse access patterns across Fanatics Commerce.

Responsibilities

Design, build, and operate real-time streaming data pipelines with low-latency delivery to MPP databases such as Star Rocks, Apache Pinot, and Apache Druid

Implement and maintain data pipelines that handle moderate to high data skew, applying techniques like bucketing, salting, and adaptive partitioning

• Work with Apache Iceberg tables for streaming workloads, including partitioning strategies, compaction tuning, file sizing, and snapshot management

• Collaborate with platform and analytics teams to model data for different consumption patterns, including real-time dashboards and analytical queries

• Optimize streaming jobs and storage layouts to improve query performance, reduce latency, and control infrastructure cost

• Assist in diagnosing and resolving performance bottlenecks related to ingestion, skew, and distributed query execution

• Contribute code, reviews, and documentation to shared data platform components and internal frameworks

• Participate in design discussions and provide technical input on streaming architecture and data modeling decisions

Required Qualifications

• 5+ years of professional software engineering and/or data engineering experience

• Kafka experience is a must (designing, building, and operating Kafka-based streaming systems in production)

• Hands-on experience building and operating production streaming pipelines with low-latency requirements

• Experience integrating streaming systems with MPP analytical databases such as Star Rocks, Apache Pinot, or Apache Druid

• Solid understanding of data skew challenges and mitigation techniques (bucketing, salting, repartitioning, adaptive strategies)

• Working knowledge of Apache Iceberg for streaming or near-real-time workloads, including table layout and compaction concepts

• Proficiency in Java and/or Python

• Strong SQL skills and understanding of distributed query execution and performance tuning

• Familiarity with data distribution strategies such as tablet distribution, bucketing, and colocation concepts

• Experience operating data pipelines in production, including monitoring, alerting, and incident response Nice to Have

• Experience contributing to open-source data or analytics projects

• Exposure to materialized views,primary key models, or real-time OLAP optimizations

• Experience working with large-scale event-driven architectures and high-throughput data systems

At Fanatics, we value transparency and honesty. If you don’t meet every single requirement, that’s okay – we still want to hear from you! We believe in the power of diverse experiences and talents. If you’re excited about the role and confident that you can contribute, don’t hesitate to apply. We’re genuinely interested in how your unique skills and perspective can help us build something amazing together.

The salary range for this position is $160,000 - $190,000 which represents base pay only and does not include short-term or long-term incentive compensation. When determining base pay, as part of a final compensation package, we consider several factors such as location, experience, qualifications, and training.

Where You’ll Work and What’s required:

• Hybrid work environment flexibility, with Tuesdays, Wednesdays, and Thursdays in office; Mondays and Fridays days remote.

• Fast-paced team environment with exposure to multiple aspects of the Fanatics Commerce business.

• Ability to travel up to 10% of the time for partner meetings, events, and other related activities.

What’s in it For You:

• Culture: Join a team where you're surrounded by top-tier talent, driven by a shared passion to relentlessly enhance the fan experience. With a focus on collaboration, support, and continuous development, you’ll be empowered to help shape a culture that celebrates both individual and team successes.

• Benefits: We provide a wide range of health, financial, legal, and development assistance, including wellness programs with fitness and weight management partners, paid maternity paternity leave, and infertility treatment. Additionally, we offer flexible time off to help you recharge, along with a competitive 401k plan to support your financial future. At Fanatics, we’re dedicated to supporting you in all aspects of work and life.