Job Title : Big Data Engineer
Location: Mountain View, CA
Duration: Long Term
.
Responsibilities:
.
· Design and develop big data solutions using industry standard technologies.
· Develop data pipelines for ingesting data from variety of 3rd party data sources such as csv files, API pulls, Json files, AWS etc. to HDFS, Hive and Vertica.
· Work with data architects to ensure that Big Data solutions are aligned with company-wide technology directions.
· Be a part of fast moving development teams using agile methodologies.
· Use best practices for unit testing, CI/CD, performance testing, capacity planning, documentation, monitoring, alerting, and incident response.
· Identify and clarify the critical few issues that need action and drive appropriate decisions and actions. Communicate results clearly and in actionable form.
· Learn and contribute to building and designing in core technologies – Hadoop, Hive, Vertica, and Tableau.
· Demonstrate strong implementation aptitude to translate objectives into a scalable solution to meet the needs of the end customer while meeting deadlines.
· Work closely with stake holders to make data usable and derive insights for analysis and decision making.
Qualifications:
· BS in Computer Science, but MS is preferred
· 3+ years of hands-on data engineering experience.
· Strong experience is designing data pipeline using python, pig, Hive, Unix
· Strong SQL experience including Hive QL and columnar database such as Vertica.
· 3+ years of experience integrating technical processes and business outcomes – specifically: data and process analysis, data quality metrics/monitoring, data architecture, developing policies/standards & supporting processes.
· Strong CS fundamentals including data structures, algorithms and distributed systems.
· Strong database fundamentals including SQL, performance and schema design.
· Strong programming skills in Java, Python, Ruby or similar.
· Good to have experience in pulling data from sources such as REST APIs, AWS, unstructured data.
· Project leadership experience, including a few years or more years leading multiple complex software development projects using agile methodologies.
· Experience using big data technologies and their applications (HDFS, Kafka, Cassandra, Columnar Databases, Graph Databases, etc).
· History of contributing to open source projects is a plus.
· AWS experience is a plus.
Regards,
Dileep Pali
Technical Recruiter- Professional Services
Droisys Inc.
Board No. : 4088748333 x 228
Email: dileep.p@droisys.com | www.droisys.com
Join Us: Linkedin | Twitter | Facebook
Nine-Time Inc. 5000 Honoree 2008, 2009, 2010, 2011, 2012, 2013, 2014,2015,2016
You received this message because you are subscribed to the Google Groups "US Jobs: Requirements, Clients and Consultants" group.
To unsubscribe from this group and stop receiving emails from it, send an email to recruiters-r-us+unsubscribe@googlegroups.com.
To post to this group, send email to recruiters-r-us@googlegroups.com.
Visit this group at https://groups.google.com/group/recruiters-r-us.
For more options, visit https://groups.google.com/d/optout.
No comments:
Post a Comment