Data Engineering & Web Crawling

Company: Theklicker
Location: Palo Alto
Posted on: April 22, 2025

Job Description:

theklicker is an innovative internet technology startup focused on connecting every person on earth to e-commerce in one place. We are dedicated to theklicker values and goals and are seeking a passionate and experienced Web Engineer to join our team and help shape the future of our company.Our team is small, highly motivated, and focused on engineering excellence. This organization is for those who appreciate challenging themselves and thrive on curiosity. Engineers are encouraged to work across multiple areas of the company, and as a result, all engineers and researchers share the title "Member of Technical Staff".We operate with a flat organizational structure. All employees are expected to be hands-on and contribute directly to the company's mission. Leadership is given to those who show initiative and consistently deliver excellence. Work ethic and strong prioritization skills are important.All engineers and researchers are expected to have strong communication skills. They should be able to concisely and accurately share knowledge with their teammates.theklicker does not have recruiters. Every application is reviewed directly by a technical member of the team.Tech Stack

• Rust
• Python
• SparkFocus
  • Building petabyte-scale, high-throughput data processing systems.
  • Managing workloads across large cloud compute clusters.
  • Pre-processing datasets for AI training.Ideal Experience
    • Building bespoke data processing libraries from scratch.
    • Designing and implementing distributed systems in Rust.
    • Keeping up with state-of-the-art techniques for preparing AI training data.
    • Organizing and meticulously bookkeeping data across multiple clouds, of multiple modalities, and from many sources.BenefitsWe offer the following employee benefits:
      • Competitive cash and equity-based compensation
      • Medical, dental, and vision insurance
      • Unlimited paid time off subject to prior approval
        #J-18808-Ljbffr

Keywords: Theklicker, Sacramento , Data Engineering & Web Crawling, IT / Software / Systems , Palo Alto, California