Our team is seeking a senior software engineer who will be a core team member for our advertising data platform engineering group. This engineering group focuses on big data infrastructure, operational data, audience solution, inventory forecasting and full funnel measurements as a foundation layer for ClientÂ's addressable Ad Platforms.
Basic Qualifications:
4+ years of professional programming in Java, Scala, Python, and etc.
3+ years of big data development experience with technical stacks like Spark, Flink, Singlestore, Kafka, Nifi and AWS big data technologies
Knowledge of system, application design and architecture
Experience of build industry level high available and scalable service
Passion about technologies, and openness to interdisciplinary work
Preferred Qualifications:
Experience with processing large amounts of data at petabyte level
Demonstrated ability with cloud infrastructure technologies, including Terraform, K8S, Spinnaker, IAM, ALB, and etc.
Experience with ClickHouse, Druid, Snowflake, Impala, Presto, Kinesis, etc.
Experience in widely used Web framework (React.js, Vue.js, Angular, etc.) and good knowledge of Web stack HTML, CSS, Webpack
Responsibilities:
Build components of large-scale data platform for real-time and batch processing, and own features of big data applications to fit evolving business needs
Build next-gen cloud based big data infrastructure for batch and streaming data applications, and continuously improve performance, scalability and availability
Contribute to the best engineering practices, including the use of design patterns, CI/CD, code review and automated test
Chip in ground-breaking innovation and apply the state-of-the-art technologies
As a key member of the team, contribute to all aspects of the software lifecycle: design, experimentation, implementation and testing.
Collaborate with program managers, product managers, SDET, and researchers in an open and innovative environment
Required Education:
BS STEM- MUST
Preferred Education:
Bachelor or above in computer science or EE
Must have skills:
Spark, Scala, Spring/Spring Boot/Java
3-5 years general experience in addition to having experience in production - having worked at a company in prod environments - Operationalize and productionize of systems having worked on both
Data pipeline experience
Software engineering in Big Data experience
Ad targeting business domain experience.
Reference : Software Engineer- Pipeline Engineer jobs
Source: http://jobrealtime.com/jobs/technology/software-engineer-pipeline-engineer_i20071
No comments:
Post a Comment