[Help] DB Value Convert to Json File

Gwynbleidd

Well-known member
  • Aug 7, 2020
    11,793
    22,049
    113
    Kaer Morhen
    thewitcher.com
    meka thmai query eka. localhost eke baba vage wada. server ekata dammama thmai case. kohemath server eke low budjet hinda wenna athi case eka. meke data tibbe 12000 vage.

    $get_pro = "select * from post where (Title LIKE '%".$urlX."%' OR Title LIKE '%".$reverse_txt."%' OR Description LIKE '%".$reverse_txt."%' OR Description LIKE '%".$urlX."%'
    OR Title LIKE '%".$last_word."%' OR Description LIKE '%".$last_word."%' OR Keywords Like '%".$urlX."%' OR
    Keywords Like '%".$reverse_txt."%' OR Keywords Like '%".$last_word."%') && Status = 'Enable'
    ORDER BY Views * 1 ASC limit $start_from, $per_page
    ";

    -------------------------------------------------------------------------------------------------------------------------------------

    man dan hadanna yanne wena project ekak. eke mata oni mecharai. kawuruhari search kalama ara json file eken similar record tika choose karla pennana vitrai search quety adlawa. man dan 1lak json file data aran shared hosting dala fetch karla baluwa. lag wenne na.

    ex: song name eka gahuwama eke search query title ekai download link ekai pennana eka.

    man issrahaa update ekak dennum.
    mata nan danumak na bn ochchara hehe 😂.. @HAneo
     

    baba-chuti

    Well-known member
  • Feb 27, 2017
    6,791
    9,482
    113
    අද කාලේ මොන app එකක් host කරන්න ගියත් හරහට හිටින්නේ database cost ඒක බන්.. Mysql හොඳ hosting පට්ට ගණන්.. මන් පස්සෙ aws dynamodb වලට ගියා ඒක pay as you go නිසා.. කට්ටිය කියනවා එකත් high user traffic එකකදී ගනං වැඩි කියල
    mage site 2k run wenawa shared eke.dawaskata 15000 enawa. third party API base yana hinda lag case na. man hadanna yana eka db eken ganna hinda thma case wune. man dan 1lak json create karla dala baluwa. 1lak record fetch kalath lag wune echra. man issrahata update ekak dennum.
     

    Anonymous_Abstract

    Well-known member
  • Aug 7, 2018
    6,036
    4,566
    113
    Messier 87
    JSON ma neme mcn. MySQL eke snapshot ekak thama ganna oni. H2 , derby kiyanneth mysql wagema RDBMS ekak neh.. index ehema dannath puluwan.
    ohoma karoth update ekadi dekama update karanna ona veda vedi. @HAneo kiyapu vidiyata normalize karala ariyata mapping karoth usage eka vedi venava budget thiyanava nam oka hariyata karanavanam oka thami krame. budget na kiyala normalize and denormalize venama tables vala thibboth modification valadi karadarai veda vedi. meka 2022 na ban mama nam kiyanne Mongodb Embedded documents valata yanna kiyala.

    man dan hadanna yanne wena project ekak. eke mata oni mecharai. kawuruhari search kalama ara json file eken similar record tika choose karla pennana vitrai search quety adlawa. man dan 1lak json file data aran shared hosting dala fetch karla baluwa. lag wenne na.

    ex: song name eka gahuwama eke search query title ekai download link ekai pennana eka.

    man issrahaa update ekak dennum.
    localhost and remote dekema thiyenna millions records nam. localhost eke baba vage veda nam. remote db eka resource vedi karapan. micro db eken xlarge veda karanna ba.

    db eke multi region nemai nam ithin region ekath balapanava.
    ------ Post added on Oct 13, 2022 at 11:57 PM
     
    Last edited:

    baba-chuti

    Well-known member
  • Feb 27, 2017
    6,791
    9,482
    113
    ohoma karoth update ekadi dekama update karanna ona veda vedi. @HAneo kiyapu vidiyata normalize karala ariyata mapping karoth usage eka vedi venava budget thiyanava nam oka hariyata karanavanam oka thami krame. budget na kiyala normalize and denormalize venama tables vala thibboth modification valadi karadarai veda vedi. meka 2022 na ban mama nam kiyanne Mongodb Embedded documents valata yanna kiyala.


    localhost and remote dekema thiyenna millions records nam. localhost eke baba vage veda nam. remote db eka resource vedi karapan. micro db eken xlarge veda karanna ba
    ------ Post added on Oct 13, 2022 at 11:57 PM
    shared hosting eke resource expand karna option eka na. mama hitanne budget hosting wala ena case ekak vage.
     

    Anonymous_Abstract

    Well-known member
  • Aug 7, 2018
    6,036
    4,566
    113
    Messier 87
    shared hosting eke resource expand karna option eka na. mama hitanne budget hosting wala ena case ekak vage.
    khomath owata limit thiyanava neththan unta padui. ube bandwidth valata unta gewanne venna. internet speed vaga thama limit karanava.

    DB type and model ekath balapanva lokuwatama.

    AWS RDS use karaoth Mysql micro speed eka Oracle micro ekin ganna ba. Mysql Micro = Oracle Small in RDS

    meka thmai query eka. localhost eke baba vage wada. server ekata dammama thmai case. kohemath server eke low budjet hinda wenna athi case eka. meke data tibbe 12000 vage.

    $get_pro = "select * from post where (Title LIKE '%".$urlX."%' OR Title LIKE '%".$reverse_txt."%' OR Description LIKE '%".$reverse_txt."%' OR Description LIKE '%".$urlX."%'
    OR Title LIKE '%".$last_word."%' OR Description LIKE '%".$last_word."%' OR Keywords Like '%".$urlX."%' OR
    Keywords Like '%".$reverse_txt."%' OR Keywords Like '%".$last_word."%') && Status = 'Enable'
    ORDER BY Views * 1 ASC limit $start_from, $per_page
    ";
    DB design karanava kiyanne lesi vedak nemai. othana balapan okkoma records read venava na loku time ekak. design karanna issella decide karanna ona search karanne mona column eka based karalada kiyala. based karana column ekata anuwa billions records thiyanavanam horizontal shrading valata ghilla puluwan tharam table valata kadanava read time eka adu karanna ona hinda. search character eka anuwa table eka decide karanava.

    den uba youtube eka "J" character eka type karana kota request eka yana table ekata nemai "K" search karana kota yanne.
    ------ Post added on Oct 14, 2022 at 12:36 AM
     
    Last edited:

    HAneo

    Well-known member
  • Jan 30, 2007
    12,970
    29,167
    113
    Homagama
    ohoma karoth update ekadi dekama update karanna ona veda vedi. @HAneo kiyapu vidiyata normalize karala ariyata mapping karoth usage eka vedi venava budget thiyanava nam oka hariyata karanavanam oka thami krame. budget na kiyala normalize and denormalize venama tables vala thibboth modification valadi karadarai veda vedi. meka 2022 na ban mama nam kiyanne Mongodb Embedded documents valata yanna kiyala.

    Yes, space usage eka.
    But I don't think Space is the factor here neda? CPU + RAM + Bandwidth is the key to this
    It's not that hard to sync DB's these days bro. Just 1 Shared library for the task. but when it comes to front end user does not like to wait for it. so Speed is the key. other than that what about the new data when we taking snapshot? snapshot means past. so if you Create or modify data In-memory DB also has to be synced.

    BTW No SQL has limitations when building such large queries. so it has to be organized from the beginning.
    Other than that No SQL is a very good choice
     
    • Like
    Reactions: Anonymous_Abstract

    stasia

    Well-known member
  • May 28, 2018
    12,814
    26,355
    113
    כדור הארץ
    ඔල්මාදෙද යකෝ කදිම db එක json walata ගන්නේ. Search කරන්න වගේ දේකට නම් data algolia වගේ එකකට දාපන්.
     
    • Love
    Reactions: baba-chuti

    knight11

    Active member
  • Jun 1, 2011
    586
    108
    43
    meka thmai query eka. localhost eke baba vage wada. server ekata dammama thmai case. kohemath server eke low budjet hinda wenna athi case eka. meke data tibbe 12000 vage.

    $get_pro = "select * from post where (Title LIKE '%".$urlX."%' OR Title LIKE '%".$reverse_txt."%' OR Description LIKE '%".$reverse_txt."%' OR Description LIKE '%".$urlX."%'
    OR Title LIKE '%".$last_word."%' OR Description LIKE '%".$last_word."%' OR Keywords Like '%".$urlX."%' OR
    Keywords Like '%".$reverse_txt."%' OR Keywords Like '%".$last_word."%') && Status = 'Enable'
    ORDER BY Views * 1 ASC limit $start_from, $per_page
    ";

    -------------------------------------------------------------------------------------------------------------------------------------

    man dan hadanna yanne wena project ekak. eke mata oni mecharai. kawuruhari search kalama ara json file eken similar record tika choose karla pennana vitrai search quety adlawa. man dan 1lak json file data aran shared hosting dala fetch karla baluwa. lag wenne na.

    ex: song name eka gahuwama eke search query title ekai download link ekai pennana eka.

    man issrahaa update ekak dennum.
    LIKE keyword does not work well with indexing. it can reduce performance when used with large datasets.
    If you want to keep using LIKE, try enabling Full-Text Search options.
    Also using an in-memory cache like Memcache-D or Redis can improve the performance.