Emphasize on Kafka spark streaming and real time data ingestion.
Hello,
We are currently looking for "Big Data Architect" and your profile appears to be a good match.
Please find the Job description below and contact me at your earliest possible convenience.
Role: Big Data Architect
Duration: 12 Months
Location: Thousand Oaks, CA
Required:
· Understand detailed solution requirements
· Overall design of Ingestion, Data integration and Data Visualization components on Cloudera stack in AWS
· Ensuring development of Ingestion, Data Integration and Data Visualization components.
· Responsible for working with Amgen and offshore team in delivering Ingestion components
· Design Batch ingestion components using Sqoop scripts, data integration and processing components using shell scripts, pig scripts, hive scripts and impala scripts
· Understanding design and developing real time ingestion components using Kafka and Spark Streaming
· Batch ingestion components using Sqoop scripts, data integration and processing components using shell scripts, pig scripts, hive scripts and impala scripts
· Defining workflow and scheduling all the processes involved using Oozie
Skills :
· 10+ years of experience in Big Data
· Must have experience of real time data ingestion
· Extremely good knowledge of Kafka, Spark Streaming, SparkSQL, Impala, Oozie, Hive, Pig
· Very Good communication skills
Thanks and Regards,
Chandrashekhar Kumar
Technical Recruiter
Diverse Lynx, LLC
Phone: 732-452-1006 Extn 265
Fax: 732-452-0684
Email – chandrashekhar.kumar@diverselynx.com
You received this message because you are subscribed to the Google Groups "US Jobs: Requirements, Clients and Consultants" group.
To unsubscribe from this group and stop receiving emails from it, send an email to recruiters-r-us+unsubscribe@googlegroups.com.
To post to this group, send email to recruiters-r-us@googlegroups.com.
Visit this group at https://groups.google.com/group/recruiters-r-us.
For more options, visit https://groups.google.com/d/optout.
No comments:
Post a Comment