Building Effective and Efficient Procedure for Preprocessing Marketplace Data

Rapid development of digitalization have enforced National Statistics Offices to utilize big data as one of new sources for producing official statistics. An alternative source is marketplace data which now growing rapidly. Many challenges exist for transforming these massive datasets into statistic...

Full description

Saved in:

Bibliographic Details
Published in:	2020 12th International Conference on Information Technology and Electrical Engineering (ICITEE) pp. 186 - 191
Main Authors:	Bustaman, Usman, Larasati, Dhiar Niken, Hidayah Satria Putri, Zulfa, Mariyah, Siti, Takdir, Pramana, Setia
Format:	Conference Proceeding
Language:	English
Published:	IEEE 06-10-2020
Subjects:	Aggregates Big Data Data structures Economics Electrical engineering Information technology marketplace Memory management preprocessing
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!

Description
Summary:	Rapid development of digitalization have enforced National Statistics Offices to utilize big data as one of new sources for producing official statistics. An alternative source is marketplace data which now growing rapidly. Many challenges exist for transforming these massive datasets into statistics for public policy. This paper aims to explain the challenges of analyzing marketplace data and building effective and efficient preprocessing procedure to analyses big data which can be used for public policy. An optimal pipeline for preprocessing including validating, cleaning and aggregating marketplace data have been developed.
DOI:	10.1109/ICITEE49829.2020.9271717