10604 - Big Data Engineer
Company: Hyundai AutoEver America
Location: Fountain Valley
Posted on: May 13, 2022
|
|
Job Description:
Job Description 10604 - Big Data Engineer Job Description Hands
on experience on Big Data ecosystem Mastering/Leading in the
development of applications/tools using Sqoop, Spark, Python, Scala
packages Good understanding of BI tools (Tableau/Power BI,
MicroStrategy) for Big Data Knowledge on Big suites Hive, Oozie,
Kafka, good experience in Hadoop (Native) Big Data processing
Experience of writing Hive queries Familiarity with development
best practices such as code reviews and unit testing. Experience in
designing the automation framework using Python, Perl and Shell
scripting. Leading, guiding and helping the team members with the
challenges faced during the project development process and problem
solving. Have flexibility and ability to learn and use new
technologies and to work in team environment as wells as
independently to get things done Excellent communications skill
Experience in working with client and handle the pressure
Diagnosing software issues and engineering workarounds Experience
in working with users, user roles using Ranger Good understanding
on security and administration Technology --- Big data (Native)
Ecosystem OS: CentOS/Linux/Unix Tool/Programs: Sqoop, Spark,
Impala, Python, Scala Database: Hive, HBase, NoSQL Qualification
--- Bachelor---s Degree in Computer Science or equivalent Primary
Responsibilities Act as a Big data subject/solution matter expert
and liaison to Big Data users and IT Serve as an escalation point
for production and/or platform issues and acts as lead liaison with
Technical Support to resolve outstanding issues within the Big Data
environment Execute actions necessary to achieve and maintain
optimum Big Data platform performance, reliability and availability
Identify bottlenecks in production systems and provide solutions
Provide Big Data Platform capacity planning, metrics, and
performance tuning recommendations Use Big Data Management tools
(Ranger) Creating Users/Groups/Roles Creating and using Access
Control Templates Creating, deployment and scheduling jobs Defining
connections to data sources, libraries, metadata objects, and
folder structures Qualifications 5 years of experience working with
and maintaining IT Application support. 3 years of experience with
Big Data Engineer Experience in production data loads and
data/storage management for multiple data sources. Knowledge of
change management procedures and version control is required
Experience/Knowledge of application security, performance and
tuning Passion about technology and continuous learning and
mastering computer-related technologies Strong communication skills
and ability to work as a team Good to have Strong knowledge of Big
Data open-source communities. Advanced analytics tools like R, SAS,
Python Experience in using ML, RPA Powered by JazzHR AS40Qn4MEl
Keywords: Hyundai AutoEver America, Fountain Valley , 10604 - Big Data Engineer, Engineering , Fountain Valley, California
Click
here to apply!
|