Discover and read the best of Twitter Threads about #dataprocessing

Most recents (4)

1/11 ๐Ÿšจ Attention developers! The new EU Data Act may impact smart contract development, but @Conste11ation $DAG offers a solution for building dApps in compliance with new regulations. Here's why you should consider Constellation for your projects. ๐ŸŒ #EUDataAct #SmartContracts
2/10 ๐Ÿ“œ The EU Data Act is not specifically aimed at the crypto industry, but it focuses on IoT data. However, it could have implications for smart contracts, which underpin DeFi infrastructure, if the scope isn't clearly defined. โš ๏ธ #IoT #DeFi
3/10 ๐Ÿ” Article 30 of the Data Act focuses on "essential requirements regarding smart contracts for data sharing" and includes rigorous access control mechanisms, trade secret protections, and termination or interruption possibilities. ๐Ÿ›ก๏ธ #SmartContractRegulations
Read 11 tweets
1/10 @Conste11ation $DAG & @quant_network $QNT groundbreaking partnership to revolutionize blockchain technology and cryptocurrency, focusing on secure, scalable, and connected ecosystems! A new era of interoperability is upon us! ๐ŸŒ #BlockchainIntegration
2/10 ๐Ÿค The $DAG & $QNT collaboration brings together Constellation's HyperGraph network and Quant's Overledger, enabling seamless integration, enhanced scalability, and top-notch security for businesses looking to embrace blockchain technology. ๐Ÿ›ก๏ธ #CryptoPartnership
3/10 ๐Ÿ™๏ธ Connected cities are set to transform with this partnership! $DAG's HyperGraph network will enrich #IoT data by incorporating public data feeds, such as transit and financial data, to create smarter and more autonomous networks. ๐ŸŒŸ #SmartCities
Read 10 tweets
How to consume any Database as a Stream for heavy data processing using JavaScript ๐Ÿคฏ๐Ÿ”ฅ

๐Ÿงต/1

#javascript #nodejs #streams #sql #nosql #tutorial #dataprocessing #database #business #data #strategy #pipeline @nodejs
The secret for processing anything using JavaScript is to handle data on demand.

Imagine data you wanna migrate data from a SQL database to a NoSQL DB. You would need to apply some business rules, clean up fields, filter data and then output them to the final output.

/2
You might know that you can block the Node.js (and the data source you're consuming) if you handle too much data at once in memory

The best practice then is to limit results, send individual data to a stream pipeline, and then ask for more data until you've consumed it all.

/3
Read 7 tweets
Why JavaScript Generators fix 90% of your problems when working with big loads of data ๐Ÿคฏ

Let's? ๐Ÿงต /1 Image
I've seen many people facing performance problems on the @nodejs platform or even on vanilla JS on the browser and when I ask what's happening they usually blame the language. /2
Although, when I look at the implementation, I see they are trying to process all the data simultaneously. /3
Read 10 tweets

Related hashtags

Did Thread Reader help you today?

Support us! We are indie developers!


This site is made by just two indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3.00/month or $30.00/year) and get exclusive features!

Become Premium

Too expensive? Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal Become our Patreon

Thank you for your support!