Kiểm tra với người bán Việc làm Hà Nội tuyển gấp Big Data – Hadoop Engineer

Mô tả công việc Tổng quan về công việc và trách nhiệm HCL is setting up large delivery centres for digital transformation projects in Vietnam and as part of that we are starting a delivery centre in Ho Chi Minh City for Data transformation initiative of a major Global Bank. Work involves transforming legacy data into modern digital data technology and hosting it in Google Cloud Platform. This is an exciting project in which employees get opportunity to experience most modern data tool stack. Project is delivered in agile ways of working, an excellent opportunity to work for a global leader. As a Hadoop big data engineer, you will develop, operate and drive scalable and resilient data platform based on Hadoop ecosystem to address the business requirements: • Ensure industry best practices around data pipelines, metadata management, data quality, data governance and data privacy • Design and implement business-specific large-scale data processing pipelines • Work with complex data structures, manipulate, cleanse data, and perform transformations to make insights from data. • Responsible to Ingest data from files, streams, and databases. Process the data with PySpark, Kafka, Hive, Hive LLAP… • Develop efficient software code for multiple use cases leveraging Spark and Big Data Technologies for various use cases built on the platform • Provide high operational excellence guaranteeing high availability and platform stability. Quyền lợi được hưởng Tại sao ứng viên nên làm ở đây - Attractive package including base salary + 13th-month salary + Performance Bonus - Insurance based on full base salary - Meal allowance 730,000/month - 100% of full salary and benefits as an official employee from the 1st day of work - Medical Benefit (Bao Viet Insurance Package) for Employee and Family - Working in a fast-paced, flexible, and multinational working environment with the opportunity to travel onsite (in 49 countries) - Internal Training (Technical & Functional & English) - Working time: 8:30 am-6:00 pm from Mondays to Fridays Yêu cầu kỹ năng Kỹ năng và kinh nghiệm tối thiểu • Experience in Hadoop ecosystem including HDFS, MapReduce, YARN, HBase, Zookeeper, Pig, Hive… • Experience in building large-scale data processing (batch-processing, stream processing) • Experience with Apache Spark preferably in PySpark • Understanding of SLA and meeting Timelines for support activities Ưu tiên có kỹ năng và kinh nghiệm • At least 3 years of relevant working experience • Experience with Hadoop distributions such as Cloudera, HortonWorks, comparison and feasibility • Experience in Apache Kafka, Apache Beam • Experience with Data warehouse • Experience in ETL • Experience in Data management: o Data Governance o Data Architecture o Data Modelling o Data Quality o Data integration • Experience in SQL and NoSQL Database • Good in programming language Python, Java • Experience with SRE, Patching & Automation: Kubernetes or Docker & Containerization • Experience working with Big Data on Cloud environment • Experience with Google Cloud • Experience in Backend development using Java • Experience in Data API • Good to have Architecture knowledge or experience Liên hệ - Người liên hệ: Nguyễn Thành Trung - Email: [email protected] - Điện thoại: 0868912816 - Điạ chỉ: B707 Chung cư An Bình, Bình Đường 2, Dĩ An Bình Dương

Liên hệ người bán Chia sẻ

Thảo luận