BFSI_Big Data_Hadoop Engineer - HCL Vietnam

BFSI_Big Data_Hadoop Engineer

  • Experience Range: 3 - 10 years
  • Job Location: Hanoi/ HCM
  • Duty & Responsibilities:

    As a Hadoop big data engineer, you will develop, operate and drive scalable and resilient data platform
    based on Hadoop ecosystem to address the business requirements:
    • Ensure industry best practices around data pipelines, metadata management, data quality, data
    governance and data privacy
    • Design and implement business-specific large-scale data processing pipelines
    • Work with complex data structures, manipulate, cleanse data, and perform transformations to
    make insights from data.
    • Responsible to Ingest data from files, streams, and databases. Process the data with PySpark,
    Kafka, Hive, Hive LLAP…
    • Develop efficient software code for multiple use cases leveraging Spark and Big Data
    Technologies for various use cases built on the platform
    • Provide high operational excellence guaranteeing high availability and platform stability.

  • Reqirements:

    ➢ Must requirements:
    • Experience in Hadoop ecosystem including HDFS, MapReduce, YARN, HBase, Zookeeper, Pig,
    • Experience in building large-scale data processing (batch-processing, stream processing)
    • Experience with Apache Spark preferably in PySpark
    • Understanding of SLA and meeting Timelines for support activities
    ➢ Good to Have:
    • Experience with Hadoop distributions such as Cloudera, HortonWorks, comparison and
    • Experience in Apache Kafka, Apache Beam
    • Experience with Data warehouse
    • Experience in ETL
    • Experience in Data management:
    o Data Governance
    o Data Architecture
    o Data Modelling
    o Data Quality
    o Data integration
    • Experience in SQL and NoSQL Database
    • Good in programming language Python, Java
    • Experience with SRE, Patching & Automation: Kubernetes or Docker & Containerization
    • Experience working with Big Data on Cloud environment
    • Experience with Google Cloud
    • Experience in Backend development using Java
    • Experience in Data API
    • Good to have Architecture knowledge or experience

  • Benefit:

    • From the 1st day at work: 100% full of salary
    • Insurance plan based on full salary + 13th salary + Performance Bonus.
    • 18 paid leaves per year (including 12 annual leaves + 6 personal leaves).
    • Medical Benefit for employee and family
    • Working in a fast paced, flexible, and multinational working environment. Chance to travel onsite (in 49 countries).
    • Internal Training (Technical & Functional & English).
    • Working from Mondays to Fridays.

  • Preferred Language for Application: English

Fill in the details!