Software Engineer (Hadoop)
Dattel
AI-generated summary
beta
Oops, looks like Ashley forgot to summarize this job! We apologize for the inconvenience. Please read the complete Job Description for full details and additional information.
Undisclosed
Petaling Jaya
Full-Time
Job Description
- Design and implement distributed data processing pipelines using Spark, Hive, Sqoop, and other tools and languages prevalent in the Hadoop ecosystem.
- Design and implement end-to-end solutions.
- Build utilities, user-defined functions, and frameworks to better enable data flow patterns.
- Research, evaluate, and utilize new technologies/tools/frameworks centred around Hadoop and other elements in the Big Data space.
- Define and build data acquisitions and consumption strategies.
- Work with architecture/data management leads and other teams to ensure quality solutions are implemented and engineering best practices are defined and adhered to.
- Familiarity with all phases of software development life cycle including analysis, design, functionality, testing and support.
- Design and develop REST APIs for rich client applications.
- Write well-designed, testable code,
- Document and maintain software functionality.
- Troubleshoot, debug and upgrade existing systems.
- Help maintain code quality, organization, and documentation.
- Identify and correct bottlenecks and fix bugs.
- Familiar and able to write optimize SQL queries.
- Ensure the best possible performance, quality and responsiveness of the application.
- Able to communicate clearly with frontend developers, business users and project managers.
Job Requirements
- Strong development skills around Hadoop, Spark, MapReduce, and Hive.
- 1+ year experience in Hadoop.
- Strong understanding of Hadoop internals.
- Experience with performance/scalability tuning, algorithms, and computational complexity.
- Experience (at least familiarity) with data warehousing, dimensional modelling, and ETL development.
- Ability to understand ERDs and relational database schemes.
- Proven ability to work with cross-functional teams to deliver appropriate resolution.
- Familiarity with RESTful APIs implementation.
- Strong Java programming, Python, shell scripting, and SQL.
- Experience with offline storage, threading, and performance tuning.
- Ability to understand business requirements and translate them into technical requirements.
- Diploma or University degree preferred.
Company Benefits
Dental Allowance
Toothache is getting in your way? Worry not and book an appointment with the dentist. We got you covered.
Talent Mobility
You'll get the chance to experience a new work environment and culture when you've been assigned to our regional offices in Bangkok and Jakarta.
Spectacles Allowance
Looking at the screens all day can deteriorate your vision. Get yourself a brand new spectacles to help you go through the blurry days.
Gym Allowance
Get fit and be healthy by working out at your selected gym during your free time. You can also check out the gym downstairs for enrollment.
Additional Info
Experience Level
0 - 7 Years of Experience
Job Specialisation
General IT
Company Profile
Dattel
Revolutionising Marketing-Tech in ASEAN; making Data simple, accessible and actionable.
We aspire to “Connect 650mil ASEANs Consumers”
Founded in 2014 as a boutique, research & advisory firm. By 2018, we transformed ourselves into a data analytics & intelligence firm focusing on Consumers, Media & E-Commerce
Since 2017, approximately RM 30mil+ have been invested for R&D purposes and Market seeding.
Currently, Dattel operates in Malaysia (HQ), Indonesia and Thailand, with a corporate holding entity out of Singapore.
With the Covid pandemic near an end, we hope to reignite our expansion into Vietnam, Philippines and Myanmar by end 2023
