Software Engineer (Big Data)
Software Engineer (Big Data)
Quantcast
San Francisco, CA
See who Quantcast has hired for this role
See who Quantcast has hired for this role
We are seeking a Software Engineer to join our Big Data Services team. This role focuses on building, maintaining, and optimizing large-scale data processing systems while supporting the needs of our data science and engineering teams.
You will work closely with engineers, data scientists, and researchers to ensure a reliable, scalable, and efficient data infrastructure that powers advanced analytics and modeling workflows.
The primary focus of the team is driving and developing systems and services that enable Quantcast to scale its distributed storage and compute platform. The ideal candidate has a passion for large-scale distributed systems (e.g., HDFS and Spark).
What You'll Do
- Contribute to the development and optimization of large-scale data workflows using technologies such as Apache Spark or similar frameworks
- Develop and operate our large scale data processing systems, making them more elastic and fault tolerant, solving distributed data and compute challenges
- Assist in deploying and maintaining production systems, including CI/CD workflows
- Provide technical input into roadmaps for the team
- Write clean, maintainable, and well-tested code
- Recent graduate (0-1 years) with a Bachelor's Degree in computer science or equivalent experience
- Familiarity with data processing frameworks such as Apache Spark, Hadoop, or similar.
- Familiarity with containerization tools (e.g., Docker and Kubernetes)
- Experience with workflow orchestration tools (e.g., Airflow) is a plus
- Proficient in Java and/or Python programming languages
- Linux system administration/automation is a plus
- Strong problem-solving and debugging skills
- Organized and detail-oriented
- Hands-on experience with large-scale distributed systems in production
- Exposure to real-world data science and modeling workflows
- Best practices in building scalable and reliable data infrastructure
- Collaboration across engineering and modeling teams
At Quantcast, we craft offers that reflect your unique skills, expertise, and geographic location. On top of a competitive salary, this position includes a performance bonus, equity, and a comprehensive benefits package. For more details, visit our Careers Page and see how we support our team. We are headquartered in San Francisco with offices around the world. Quantcast is an Equal Opportunity Employer. Please see the Applicant Privacy Notice for details on our applicant privacy policy. Join the team that unlocks potential.
-
Seniority level
Entry level -
Employment type
Full-time -
Job function
Engineering and Information Technology -
Industries
Technology, Information and Internet
Referrals increase your chances of interviewing at Quantcast by 2x
See who you knowGet notified about new Software Engineer jobs in San Francisco, CA.
Sign in to create job alertSimilar jobs
People also viewed
-
Software Engineer, Experimental Projects
Software Engineer, Experimental Projects
-
Full Stack Software Engineer
Full Stack Software Engineer
-
Software Engineer, Bridge
Software Engineer, Bridge
-
Software Engineer
Software Engineer
-
Backend Software Engineer, Growth
Backend Software Engineer, Growth
-
Software Engineer, Bridge
Software Engineer, Bridge
-
Software Engineer, Backend
Software Engineer, Backend
-
Software Engineer
Software Engineer
-
Software Engineer ($140K – $210K + Equity) at Ambrook
Software Engineer ($140K – $210K + Equity) at Ambrook
-
Full-Stack Software Engineer (in-person / remote optional)
Full-Stack Software Engineer (in-person / remote optional)
Similar Searches
Explore top content on LinkedIn
Find curated posts and insights for relevant topics all in one place.
View top content