getSummary
Written in English from the original postingThis internship involves working with high-volume streaming data and database-centric information. The intern will gain experience in big data manipulation, database design, programming, and real-time data enrichment. Possible projects include DPI acceleration, pcap search, and KSQL stream processing.
Job description
Duration: 2 - 4 Months
Internship Type: Undergraduate; Pre-University
Raw data flows at high speed and high volume across enterprise systems. The multiplicity of file format and erroneous file content often make integration and maintenance of systems a challenging task. Data Engineers need to find trends in this complex environment and develop algorithms to make raw streaming data useful to the organisation.
As a Data Engineer intern, you will:
- Gain valuable experience in big data manipulation and acquire deep knowledge in database design and programming.
- Learn to manage, analyse and extract database-centric distinctive information and enrich them in real time to provide value to the end user.
- Be able to hone your technical skills using multiple programming languages and scripting tools.
Broad Deliverables
- Conduct technology scan and proof-of-concept.
- Data acquisition, query and manipulation to address business issues.
- Design, develop, test and deliver the system.
- Present the system to management and users.
Possible Projects*
- DPI accelerator (using Snort/Regex)
- Pcap search engine
- KSQL real-time stream processing
Prerequisites/Skills Required
- Prior knowledge in programming