Responsibilities:
- Build and optimize big data pipelines to extract and process signals from the web, job postings, and other sources
- Design and implement data architectures and storage solutions to efficiently handle massive data volumes
- Collaborate closely with data scientists to support and integrate ML models into data workflows
- Continuously improve data quality, performance, and scalability of our technographic data platform
- Drive technical strategy and roadmap for the data processing infrastructure.
Requirements:
- Extensive experience building and scaling big data pipelines and architectures from scratch
- Deep expertise in big data frameworks (Hadoop, Spark) and the JVM stack (Java, Scala)
- Strong software engineering fundamentals and ability to write efficient, high-quality code
- Experience with entity recognition and NLP techniques a plus
- Proven track record delivering results and driving projects in a fast-paced environment
- Excellent collaboration and communication skills to work with data scientists, analysts and product teams
- Passion for leveraging huge datasets to power valuable insights.
Ideal Background:
- 10+ years of experience in software engineering roles.
- Experience working with very large datasets and distributed systems
- Familiarity building data pipelines at large tech companies or data-driven organizations
- Bachelor's or advanced degree in Computer Science, Engineering or related technical field.
Benefits:
- Comprehensive benefits including holistic mind, body and lifestyle programs designed for overall well-being.
Additional Information:
- Actual compensation offered will be based on factors such as the candidate’s work location, qualifications, skills, experience and/or training.
- Your recruiter can share more information about the specific salary range for your desired work location during the hiring process.
- Below is the US base salary for this position. Additional compensation such as Bonus, Commission, Equity and other benefits may also apply.
This position is remote within the US and Canada (locations mentioned include US states and Toronto, Canada).
Зарплаты и спрос: Дата-инженер
Сейчас в каталоге 676 вакансий по этому направлению, удалённо можно работать в 39%.
Середина вилки в этой вакансии, 211 000 $ в год, на 8% выше медианы по направлению (195 000 $). У половины вакансий от 148 000 $ до 216 000 $ (вакансий с вилкой: 40).
Навыки этой вакансии, которые чаще всего просят по направлению: Spark (13%). В скобках доля вакансий направления.