TUGAS AKHIR MAHASISWA 14240022

TUGAS AKHIR MAHASISWA 14240022

• By Aldi Kenny; Saputra Irwansyah;
• Tesis
• 86

Data operasional alat berat memerlukan pencatatan yang akurat sejak tahap input hingga verifikasi integritas. Penelitian ini bertujuan menganalisis pengaruh pre-filtering audio berbasis Voice Activity Detection (VAD) terhadap akurasi transkripsi, kinerja Oracle Validation Gate, performa komputasi, dan integritas data pada pipeline Speech-to-Ledger. Metode yang digunakan adalah eksperimen kuantitatif faktorial 2×3 terhadap 60 sampel audio atau 120 observasi, dengan membandingkan mode tanpa VAD dan mode VAD pada kondisi clean, medium noise, dan high noise. Hasil menunjukkan rata-rata Word Error Rate sebesar 1,05% tanpa VAD dan 0,82% dengan VAD. Namun, perbedaan WER, Validation Pass Rate, dan latency tidak signifikan secara statistik. Pengaruh VAD bersifat kondisional: membantu pada audio bersih, tetapi dapat memotong segmen ucapan pada noise tinggi. Mekanisme SHA-256 dan Hyperledger Fabric mencapai Tamper Detection Rate 100%. Disimpulkan bahwa VAD perlu diterapkan secara adaptif, sedangkan Oracle Gate dan blockchain tetap penting untuk validasi dan integritas data.

• Katakunci aktivitas suara, blockchain, integritas data, Oracle Validation Gate, pengenalan ucapan otomatis
• URL http://
• Penerbit universitas nusa mandiri,

REFERENSI

[1]      A. Radford, J. W. Kim, T. Xu, G. Brockman, C. McLeavey, and I. Sutskever, “Robust Speech Recognition via Large-Scale Weak Supervision,” Dec. 2022, [Online]. Available: http://arxiv.org/abs/2212.04356

[2]      H. Tohir, N. Merlina, and M. Haris, “UTILIZING RETRIEVAL-AUGMENTED GENERATION IN LARGE LANGUAGE MODELS TO ENHANCE INDONESIAN LANGUAGE NLP,” JITK (Jurnal Ilmu Pengetahuan dan Teknologi Komputer), vol. 10, no. 2, pp. 352–360, Nov. 2024, doi: 10.33480/jitk.v10i2.5916.

[3]      S. Hadianti et al., “WORD2VEC OPTIMALIZATION USING TRANSFER LEARNING IN INDONESIAN LANGUAGE FOR HIGHER EDUCATION,” JITK (Jurnal Ilmu Pengetahuan dan Teknologi Komputer), vol. 11, no. 2, pp. 382–390, Nov. 2025, doi: 10.33480/jitk.v11i2.6051.

[4]      N. S. Sunendar and I. Saputra, “COMPARATIVE PERFORMANCE OF TRANSFORMER AND LSTM MODELS FOR INDONESIAN INFORMATION RETRIEVAL WITH INDOBERT,” Jurnal Pilar Nusa Mandiri, vol. 21, no. 2, pp. 228–233, Sep. 2025, doi: 10.33480/pilar.v21i2.6920.

[5]      A. Iftekhar and X. Cui, “Anti-Tamper Protection for Internet of Things System Using Hyperledger Fabric Blockchain Technology,” Sep. 2021, [Online]. Available: http://arxiv.org/abs/2109.07074

[6]      B.-Y. Su, B. Chen, S.-C. Huang, and J.-W. Hung, “A Comparative Experimental Study on Simple Features and Lightweight Models for Voice Activity Detection in Noisy Environments,” Electronics (Basel)., vol. 15, no. 2, p. 263, Jan. 2026, doi: 10.3390/electronics15020263.

[7]      A. Koenecke, A. S. G. Choi, K. X. Mei, H. Schellmann, and M. Sloane, “Careless Whisper: Speech-to-Text Hallucination Harms,” in The 2024 ACM Conference on Fairness, Accountability, and Transparency, New York, NY, USA: ACM, Jun. 2024, pp. 1672–1681. doi: 10.1145/3630106.3658996.

[8]      H. Atwany, A. Waheed, R. Singh, M. Choudhury, and B. Raj, “Lost in Transcription, Found in Distribution Shift: Demystifying Hallucination in Speech Foundation Models,” in Findings of the Association for Computational Linguistics: ACL 2025, Stroudsburg, PA, USA: Association for Computational Linguistics, 2025, pp. 23181–23203. doi: 10.18653/v1/2025.findings-acl.1190.

[9]      S. Novitasari, T. Fukuda, and G. Kurata, “Improving ASR Robustness in Noisy Condition Through VAD Integration,” in Interspeech 2022, ISCA: ISCA, Sep. 2022, pp. 3784–3788. doi: 10.21437/Interspeech.2022-260.

[10]    D. Jurafsky and J. H. Martin, “Speech and Language Processing An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition Third Edition draft.”

[11]    A. Baevski, H. Zhou, A. Mohamed, and M. Auli, “wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations,” Oct. 2020, [Online]. Available: http://arxiv.org/abs/2006.11477

[12]    R. S. A. Pratama and A. Amrullah, “ANALYSIS OF WHISPER AUTOMATIC SPEECH RECOGNITION PERFORMANCE ON LOW RESOURCE LANGUAGE,” Jurnal Pilar Nusa Mandiri, vol. 20, no. 1, pp. 1–8, Mar. 2024, doi: 10.33480/pilar.v20i1.4633.

[13]    A. Adila, D. Lestari, A. Purwarianti, D. Tanaya, K. Azizah, and S. Sakti, “Enhancing Indonesian Automatic Speech Recognition: Evaluating Multilingual Models with Diverse Speech Variabilities,” Oct. 2024, [Online]. Available: http://arxiv.org/abs/2410.08828

[14]    C. Graham and N. Roll, “Evaluating OpenAI’s Whisper ASR: Performance analysis across diverse accents and speaker traits,” JASA Express Lett., vol. 4, no. 2, Feb. 2024, doi: 10.1121/10.0024876.

[15]    V. Riyanto, A. Saryoko, ; Anton, L. Mazia, ; Nurmalasari, and ; Tati Mardiana, “AI-DRIVEN ACADEMIC SCREENING: PENGEMBANGAN SISTEM REVIEWER OTOMATIS BERBASIS AI AGENT,” INTI NUSA MANDIR, vol. VOL. 20. NO. 2, doi: 10.33480/inti.v20i2.6793.

[16]    R. Latifahul Hasanah and E. Heni Hermaliani, “Perbandingan Tradisional dan Ensemble Machine Learning dalam Melakukan Klasifikasi Kalimat Ujaran Kebencian,” vol. 08, no. 02, 2023.

[17]    S. Ernawati and R. Wati, “Evaluasi Performa Kernel SVM dalam Analisis Sentimen Review Aplikasi ChatGPT Menggunakan Hyperparameter dan VADER Lexicon,” 2024.

[18]    V. Buterin, “Ethereum: A Next-Generation Smart Contract and Decentralized Application Platform.”

[19]    S. Nakamoto, “Bitcoin: A Peer-to-Peer Electronic Cash System.” [Online]. Available: www.bitcoin.org

[20]    E. Androulaki et al., “Hyperledger Fabric: A Distributed Operating System for Permissioned Blockchains,” Apr. 2018, doi: 10.1145/3190508.3190538.

[21]    “Secure hash standard,” 2015. doi: 10.6028/NIST.FIPS.180-4.

[22]    M. Hussan, S. A. Parah, A. Jan, and G. J. Qureshi, “Hash-based image watermarking technique for tamper detection and localization,” Health Technol. (Berl)., vol. 12, no. 2, pp. 385–400, Mar. 2022, doi: 10.1007/s12553-021-00632-9.

[23]    H. Wang and J. Zhang, “Blockchain Based Data Integrity Verification for Large-Scale IoT Data,” IEEE Access, vol. 7, pp. 164996–165006, 2019, doi: 10.1109/ACCESS.2019.2952635.

[24]    “n8n documentation: Workflow automation for technical teams,” https://docs.n8n.io.

[25]    G. De Simone, A. Greco, F. Rosa, A. Saggese, and M. Vento, “Context-aware data augmentation for enhanced speech command recognition in industrial environments,” Sci. Rep., vol. 15, no. 1, p. 17445, May 2025, doi: 10.1038/s41598-025-01886-3.

[26]    T. Desot, F. Portet, and M. Vacher, “End-to-End Spoken Language Understanding: Performance analyses of a voice command task in a low resource setting,” Comput. Speech Lang., vol. 75, p. 101369, Sep. 2022, doi: 10.1016/j.csl.2022.101369.

[27]    Jongseo Sohn, Nam Soo Kim, and Wonyong Sung, “A statistical model-based voice activity detection,” IEEE Signal Process. Lett., vol. 6, no. 1, pp. 1–3, Jan. 1999, doi: 10.1109/97.736233.

[28]    Z. Zhu, L. Zhang, K. Pei, and S. Chen, “A robust and lightweight voice activity detection algorithm for speech enhancement at low signal-to-noise ratio,” Digit. Signal Process., vol. 141, p. 104151, Sep. 2023, doi: 10.1016/j.dsp.2023.104151.

[29]    Y. Heo and S. Lee, “Supervised Contrastive Learning for Voice Activity Detection,” Electronics (Basel)., vol. 12, no. 3, p. 705, Jan. 2023, doi: 10.3390/electronics12030705.

[30]    F. F. Marcelly, I. Saputra, and M. B. Andra, “EVALUATING PREPROCESSING EFFECTS IN NAME RETRIEVAL USING CLASSICAL IR AND CNN-BASED MODELS,” Jurnal Pilar Nusa Mandiri, vol. 21, no. 2, pp. 218–227, Sep. 2025, doi: 10.33480/pilar.v21i2.6884.

[31]    R. Rifaldi and A. B. Cahyono, “Pengembangan Fitur Speech Recognition Pada Aplikasi Notulensi Menggunakan Whisper AI,” INNOVATIVE: Journal Of Social Science Research, vol. 4, pp. 8555–8566, 2024.

[32]    Y. Wang, A. Alhmoud, S. Alsahly, M. Alqurishi, and M. Ravanelli, “Calm-Whisper: Reduce Whisper Hallucination On Non-Speech By Calming Crazy Heads Down,” in Interspeech 2025, ISCA: ISCA, Aug. 2025, pp. 3414–3418. doi: 10.21437/Interspeech.2025-201.

[33]    A. Eghmazi, M. Ataei, R. J. Landry, and G. Chevrette, “Enhancing IoT Data Security: Using the Blockchain to Boost Data Integrity and Privacy,” IoT, vol. 5, no. 1, pp. 20–34, Jan. 2024, doi: 10.3390/iot5010002.

[34]    J. Chen, H. Xiao, M. Hu, and C.-M. Chen, “A blockchain-based signature exchange protocol for metaverse,” Future Generation Computer Systems, vol. 142, pp. 237–247, May 2023, doi: 10.1016/j.future.2022.12.031.

[35]    S. Zafar, S. F. U. Hassan, A. Mohammad, A. A. Al-Ahmadi, and N. Ullah, “Implementation of a Distributed Framework for Permissioned Blockchain-Based Secure Automotive Supply Chain Management,” Sensors, vol. 22, no. 19, p. 7367, Sep. 2022, doi: 10.3390/s22197367.

[36]    S. Li, T. Zhou, H. Yang, and P. Wang, “Blockchain-Based Secure Storage and Access Control Scheme for Supply Chain Ecological Business Data: A Case Study of the Automotive Industry,” Sensors, vol. 23, no. 16, Aug. 2023, doi: 10.3390/s23167036.

[37]    H. Honar Pajooh, M. Rashid, F. Alam, and S. Demidenko, “Hyperledger Fabric Blockchain for Securing the Edge Internet of Things,” Sensors, vol. 21, no. 2, p. 359, Jan. 2021, doi: 10.3390/s21020359.

[38]    F. P. Oikonomou, J. Ribeiro, G. Mantas, J. M. C. S. Bastos, and J. Rodriguez, “A Hyperledger Fabric-based Blockchain Architecture to Secure IoT-based Health Monitoring Systems,” in 2021 IEEE International Mediterranean Conference on Communications and Networking (MeditCom), IEEE, Sep. 2021, pp. 186–190. doi: 10.1109/MeditCom49071.2021.9647521.

[39]    M. McKinnon, S. Khaki, C. K. Reddy, and W. Huang, “Window Size Versus Accuracy Experiments in Voice Activity Detectors,” Jan. 2026, [Online]. Available: http://arxiv.org/abs/2601.17270

[40]    F. A. Rani, F. Ernawan, and N. A. Hamid, “Comparative Analysis of Deep Learning Methods in Money Laundering Detection with Feature Engineering Techniques,” vol. 15, no. 5, 2025.

[41]    T. Hidayat, F. Aziz, D. Uki, E. Saputri, and N. Khasanah, “Hidayat, Aziz, Saputri and Khasanah-Evaluating Of Deep Learning Models For Early Detection In Meat Classification: A Study On Beef And Pork Detection EVALUATING OF DEEP LEARNING MODELS FOR EARLY DETECTION IN MEAT CLASSIFICATION: A STUDY ON BEEF AND PORK DETECTION.”

[42]    N. Sunendar and Y. Rianto, “COMPARISON OF ARIMA, LSTM, AND GRU MODELS FOR FORECASTING SALES OF HIT AEROSOL PRODUCTS,” Jurnal Pilar Nusa Mandiri, vol. 21, no. 2, pp. 153–159, Sep. 2025, doi: 10.33480/pilar.v21i2.6412.

[43]    D. Rahmawati, K. S. Setiawan, M. F. Reynaldy, M. Rangga, and R. Saelan, “Deep Learning dengan ResNet50 untuk Sistem Rekomendasi Fashion Berbasis Citra”.

[44]    K. Aldi and Y. Rianto, “WASTEWISE: AI-POWERED WASTE EDUCATION FOR ELEMENTARY STUDENTS USING YOLOV8 AND ESP32-CAM,” Jurnal Pilar Nusa Mandiri, vol. 21, no. 2, pp. 171–177, Sep. 2025, doi: 10.33480/pilar.v21i2.6414.

[45]    M. Islam, M. H. Rehmani, and J. Chen, “Differentially Private Enhanced Permissioned Blockchain for Private Data Sharing in Industrial IoT,” Jun. 2023, [Online]. Available: http://arxiv.org/abs/2212.00068