Job Role: Big Data - Senior Consultant/Manager
Salary: 22 LPA to 30 LPA
Qualification: B.E. / B. Tech / MCA / M. Tech / MBA degree or equivalent
Mandatory Skills: Big Data,Spark,Hive
Job Description
We are hiring Big Data Developer – Senior Consultant/Manager- Delhi/NCR- BIG4
Primary Skill-
• Understanding the data patterns and solving the analytics use case
• converting the solution to Spark and other big data tools-based implementation
• building data pipelines and ETL using heterogeneous sources to Hadoop using Kafka, Flume, Sqoop, Spark Streaming etc
• tuning performance optimization of Spark data pipelines
• managing the data pipelines and delivering enhancements to solve technical issues
• automation of day-to-day tasks
• providing technical support and guidance to business users
To excel in this role, the candidate will ideally bring:
• 3+ years of experience working in Hadoop Ecosystem and big data technologies with 5-8 years of software development experience
• reading and writing Spark transformation jobs using Java, Scala (Preferably in Java)
• experience with Hadoop, Spark
• good knowledge of the core AWS services (S3, IAM, EC2, ELB, CloudFormation)
• good understanding of Linux and networking concepts
• good understanding of data architecture principles, including data access patterns and data modelling
• tertiary degree in IT or similar subject