Posted on: 11/22/2021

Job type: Permanent

Sector: IT

 
Sign up for job alerts

You will receive job alerts for:

Please enter your email address.

Silicon Valley Startup

Job responsibilities: 

You will work alongside other engineers to create a various real-time prediction systems for commerce both in the online and physical worlds.
Tech tools: Spark, AWS, Hive or Presto, Kafka

1. Develop, operate, and monitor ETL for data collection, cleansing, processing, storage, and analytics
2. Design, build, integrate data from various resources, and manage big data
3. Optimize the performance of their company’s big data ecosystem
4. Automate common data processing tasks and support data analysis tasks
5. Write documents for architecture design and implementation
6. Be a self-starter and a team player keen on mentoring others and growing your own skill set within a fast paced environment.

Qualifications: 

1. Good command of English, both written and spoken
2. Minimum 5 years of professional full-time experience in a similar role
3. Familiar with Hadoop ecosystem
4. Experience in building cloud-based data warehouses on AWS
5. Experience in using Spark on AWS’s EMR to work with massive datasets and to store in a data lake and Hive or Presto to interact with data
6. Understand the HDFS principle beneath Spark and the formats it stores out

PLUS: 
1. Knowledge of Spark-streaming & Machine Learning
2. Experience with data visualization (eg: Tableau) and CI/CD flow
3. Team lead experience
4. Experience in SaaS, e-commerce, or startup

The Company Offers:
1. Competitive salary offers based on experience
2. Annual bonuses, paid vacations, and on-going learning opportunities
3. Other company-sponsored perks

Note:
This a full-time, long-term, remote flexibility position.

 

Contact

Stanley Wu
+886 2 2757 7268 Ext 258
Rm. 1209, 12F., No.333, Sec. 1, Keelung Rd., Xinyi Dist., Taipei City 110, Taiwan
110 Taiwan
Greater China

Send job by email

Apply for Senior (Lead) Data Engineer
Reference: GC830620
Apply now for this job!
Upload your CV and confirm your details by clicking apply.
Apply with

MS Word, PDF, HTML and text formats.
or