Based onSPArksQLDesign and Implementation of distributed full-text retrieval framework based on

Jiaxin Lan

Abstract


With the deepening of Information Technology,Big Data has created great value in various fields.,Storage and fast analysis of massive data has become a new challenge..Traditional relational database due to Performance,Disadvantages of scalability and high price,Difficult to meet the storage and analysis needs of big data.Spark SQLIs based on the Big Data Processing FrameworkSparkData analysis tools,Currently supportedTPC-DSBenchmark,Become an alternative solution to traditional data warehouse under the background of big data.Full-text retrieval as an effective way of text search,Can be used in conjunction with general query operations,Provide richer query and Analysis


Keywords


Operation.; SparkSQL; Simple query operation; Full-text retrieval; traditional business migration

Full Text:

PDF

Included Database


References


SundwZhanggyZhengwm. bigdataflowcompu-tation:KeytechnologyandsystemexamplesJ. . Journalofsoft-ware201425(4):839-862.(Inchinese)

Sun da weiDivergent opinions about YanZheng wei min.Big Data Flow Cytometry Calculation:Key technology and system instance

White Po MingSun ChengChen YaoSuch..Channel Coding Technology New ProgressJ. .Radio Communication Technology201642(2):1-8.

Xu Yihua,Zhou shengkui,Zhu qiuming,Wait..UAV communication channel Simulation Based on flight trajectoryJ. .Telecommunications Technology,2013,53(5.):656-660

JiaoxpWeihyMujj. improvedadmmpenalizedde-coderforirregularlow-densityparity-checkcodesJ. . IEEE Communicationsletters201519(6):913-916.

AnassioCONDE-CANENCIALMansourmEtal. Non-binarylow-densityparity-checkcodedcycliccode-shiftke-YingC. IEEE wirelesscommunicationsandnetworkingconference. Shanghai;2013:3890-3894.

MAZShiz,Zhouc,Etal. designofsignalspacediversitybasedonnon-binaryldpccodeC. Internet communications. Fujian,China,2008:31-34.

. Rongb,Jiangt,Lix,Etal. combineldpccodesovergf()With ar modulationsforbandwidthefficienttransmisQ-y-sionJ. . Ieetransactionsonbroadcasting,2008,54(1.):78-84.

. Lig,Fairij,Krzymienwa. densityevolutionformonbiJ. . IEEE Transactionsoninformationtheory,2009,55(3.):997-1015.

Chenym,Gaoxl,Wangzx,Etal. Performanceanalysis OfnonbinaryandbinaryldpccodesJ. . Electronicdesignen-gineering,2013,23.(21.):94-95.(InChinese)

Chen mingyang,Gao Xinglong,Wang zhongxun,Wait..DiversityLDPCCode and binaryLDPCCode Performance AnalysisJ. .Electronic Design Engineering, 2013,23 (21): 94-95.

Xuyh,Zhousk,Zhuqm,Etal. simulationofuavcommunicationchannelbasedonflighttargetJ. . Tele-communicationengineering,2013,53(5.):656-660.(InChinese).

. Salamancal,Olmospm,Murilo-fuentesjj,Etal. treeexpectationpropagationformldecodingofldpccodesoverthebecJ. . Ieetransactionsoncommunications,2013,61(2.):465-473.

. Songh,Cruzjr. Reduced-complexitydecodingofq-aryldpccodesformagneticrecordingJ. . Ieetransactionsonmagnetics,2003,39(2.):1081-1087.

Wymeerschh,Steendamh,Moeneclaeym. Log-domaindecofldpccodesovergf()C. 2004 IEEE Internationalreferenceoncommunications.2004:772-776.

Zhaos,Wangx,Wangt,Etal. jointdetection-decodingof Majority-logicdecodablenonbinaryldpccodedmodulationsys-tems:AniterativenoisereductionalgorithmC. Ieeechinasummit & internationalreferenceonsignalandinformationprocessing.3:412-416.

Lacruzjo,GARCIA-HERREROF,Vallsj,Etal. One Minimumonlytrelisdecoderfornon-binarylow-density-checkcodesJ. . Ieetransactionsoncircuitsandsystemsi:Re-gularpapers,2015,62(1.):177-184.

Pentt,Yixx,Lih,Etal. OFDM-idmasystemwithldpcJ. . Journalofchongqinginstuteoftechnology,2012,26(11):80-82.(Inchinses) Peng Tao,Yi xiaoxin,Li Hui,Wait.. LDPCCode in Orthogonal Frequency Division Multiplexing-Application of Interleaving Multiple Access SystemJ. .Journal of Chongqing University of Technology, 2012,26 (11): 80-82.


Refbacks

  • There are currently no refbacks.