Discover and read the best of Twitter Threads about #Python

Most recents (24)

The fastai paper (with @GuggerSylvain) is now available on arXiv and on our site! It's been peer reviewed and will appear in the journal Information soon.

The paper covers v2, which is a from-scratch rewrite that focuses on usability and hackability.
The paper explains that by carefully crafting a layered API, fastai v2 has lots of new functionality (both new to fastai, and new to deep learning libraries in general), yet contains <10k lines of code!
A high-level API powers ready-to-use functions to train models in various applications, offering customizable models with sensible defaults. It is built on top of a hierarchy of lower level APIs which provide composable building blocks
Read 17 tweets
Are you a data scientist?


You most likely estimated or felt that coding in #Python
is harder than it really is


see #thread 👇🏼
Let me guess.

You may be a novice programmer,
or have no coding experience at all.

That's all right,
but it turns out you need to do #data #analysis.
Maybe you’ve been already using Excel for that.

You have a chaotic group of folders,
where you keep stacking all statistics that you've managed to complete so far.

But you can't, for the life of you, find a sheet tab
where you already plotted that pie chart you need again.
Read 16 tweets
Thread: a day in the life of @BFI National Archive #digipres using #FOSS @FFmpeg @MediaArea_Net #RAWcooked @MatroskaOrg to 1) preserve and 2) (yay) save cash...
Yesterday was a normalish day, oceans of data swilling around the digipres network, some servers working, some busted, some scripts working, some silently failing, some loudly failing. It’s ok, we have smart and caring human stewards to take care of this.
Anyway, we use #RAWCooked to convert our #DPX to #FFV1 #Matroska, and we use @FFmpeg to do the same for videotape digitisation, V210 MOVs to FFV1_MKVs..
Read 9 tweets
Transitioning into #DataScience: A (long) thread—
Transitioning into a new field can be cumbersome, especially #datascience which usually requires some level of #math #statistics #machinelearning #programming. But fret not!
This thread will go over the fundamentals of what you should know to become a #datascientist. First thing first, there are hundreds of tools for visualization (Power BI, Tableau, Dash), cloud computing (GCP, AWS, Azure) and SQL variants (Postgres, MSSQL, MySQL).
Don’t get caught up trying to learn all of these tools/platforms/software! You will be onboarded to these technologies and they differ highly from company to company and sometimes even department to department. But, you should be familiar with what they do at a high level!
Read 20 tweets
(1/2) #AlgorithmicTrading #AMA - We bring to you the most asked questions about #AlgoTrading. Nitesh Khandelwal (Co-founder and CEO, QuantInsti) answers them in the form of short narrative videos.

Check out the entire playlist here:
What is High-Frequency Trading, Low-Frequency Trading and Medium-Frequency Trading?

#HFT #LFT #MFT #AlgorithmicTrading #FAQs #AMA #question #answer #algotrading
Where to get historical and real-time market data?

#Data #marketdata #AlgorithmicTrading #FAQs #AMA #question #answer #algotrading #traders #trading
Read 25 tweets
If you are interested in analyzing #SingleCell #RNAseq data in #Bioconductor using #rstats, please check out our paper Orchestrating single-cell analysis (OSCA) with @Bioconductor that was published in @naturemethods this week! #genomics #scRNAseq #dataviz #methodsmatter
@Bioconductor @naturemethods OSCA is a rich, reproducible, accessible (from beginners to experts!) resource with many #scRNAseq workflows & datasets. The resource is an online #bookdown book that compiles every night to track development by the open-source and open-development @Bioconductor #rstats community
@Bioconductor @naturemethods Now, OSCA is not the only set of packages / workflows for the analysis of #scRNAseq data. #Scanpy ( and #Seurat ( and are two incredibly popular packages in #python and #rstats, respectively.
Read 9 tweets
I think most biologists would benefit from learning to code. Learning programming languages gives your brain a new way to think and is deeply satisfying (for me and probably you, too). I've collected my favorite resources for image analysis in python below #womenwhocode #python
(Quick plug: if you're intrigued about image analysis and coding and will be at #ASCBEMBO19, visit my poster at board B18 on Tuesday 12/10 from 1:30 PM - 3:00 PM, where I'll share my approach to analyze single molecule RNA data in three dimensional space!)
I approach "how to get started?" with the perspective of a self taught programmer who had developed tools that are useful to answer biological questions we have in the @LabLerit
Read 26 tweets
Vocês estão sabendo do

Primeira conferência de #Python em Português 100% online que vai acontecer durante 24h começando em 13 de Dezembro as 16h.

Segue o fio.
e dá um RT para ajudar o evento :)
O incentivo para esta conferência é possibilitar que pessoas de todos os lugares possam participar, não só como expectadores mas também como palestrantes.
Teremos duas maneiras de participação, uma é para quem ia cria conteúdo e já tem seu canal no YouTube ou Twitch para fazer uma live sobre #python em qualquer horário durante as 24h do evento.
Read 14 tweets
A @ReceitaFederal liberou ontem atualização na base de empresas/sócios (…), são 20 arquivos e o download é lento; estou baixando e em breve compartilho nessa thread o link no mirror do Brasil.IO (+ rápido) e dos arquivos convertidos.
@ReceitaFederal Terminei o download dos 20 arquivos (total: 6,1GB) e disponibilizei uma cópia no Brasil.IO em:… - fiz um teste e enquanto nos servidores oficiais demora até 3h por arquivo, no mirror demora menos de 1min.
Em breve publico os dados convertidos.
@ReceitaFederal Caso queira automatizar o download pelo terminal com wget:

mkdir data-socios-brasil && cd data-socios-brasil
for i in $(seq 20); do
wget -c -t 0 $MIRROR/DADOS_ABERTOS_CNPJ_$(printf "%02d" $i).zip
sha1sum -c SHA1SUMS
Read 10 tweets

Jadi salah satu fitur pada Python yang sering digunakan adalah Slicing ... Nah, slicing itu nanti nyamber2 index. Oleh karena itu, kita kenalan dulu sama kedua fitur ini yuk...

Salah satu fitur Python yang paling digemari oleh para programmer level menengah dan profesional adalah slicing. Jadi pada dasarnya, slicing adalah teknik untuk ‘mengambil’ nilai dari list atau string.

Apabila Anda ingin menggunakan Python untuk pemrograman yang kompleks dan serius, maka salah satu syaratnya adalah memahami konsep slicing ini dengan baik.


Apa itu Index?
Read 20 tweets
Some Libraries for #Python in #DataScience

It is used to perform scientific computations.
It is also used to leverage n-dimensional array objects, C, C++, Fortran program-based integration tools, functions for performing complex mathematical operations like Fourier transformation, linear algebra, random number.

It is stored under TensorFlow alongside other ML platforms.

This library is also used for scientific computing.

Its data structure is a multi-dimensional array, which is based on NumPy.

Read 6 tweets
A student asked me how to collect old Tweets with the Twitter Premium API, so I wrote a tutorial how to get started with the Twitter Premium API.

Looking forward to your feedback.… #python #twitter #datascience
Because the collection of Tweets is only the first step, I shared my script that creates a dynamic Retweet network from the jsonl-file.

Have fun.… #gephi #gexf #python
What do you call Lehrgeld in English?

Read 4 tweets
(1/21) Do you work with digitized manuscripts? I have 350 pages to help you out with that! "Among Digitized Manuscripts", published with @BrillPublishing. It’s out now! Download the book in open access here… More information:
(2/21) Manuscripts have been digitized in large numbers. Technology has become easy to learn. It is time to capitalize on these opportunities and accept ‘digital manuscript studies’ as a normal, yes necessary, part of our work. This book is a great start for that!
(3/21) It introduces a conceptual and practical toolbox for working with digitized manuscripts, starting with establishing a vocabulary to talk about the (quality of the) digital materiality of them and ending with explaining Python and OpenCV to do automated image analysis.
Read 22 tweets
I know you have heard of password #Salts which are similar to Nonces and used to add uniqueness to passwords and protect against pre-computed hashes (rainbow tables).

Did you also know about password #Peppers ? They are equally important too.
In modern web applications of today, you should #Pepper your passwords as well as #Salt them too before hashing them. Here is the order:

Original Password ---> Salt ---> Pepper ---> Hash ---> Store-In-DB.

However, if you #Pepper passwords wrongly. It could be very disastrous!
What do i mean by this ?

Well, the simplest (and safest - very important) way to #Pepper a password is to HMAC(Original_Password, key) it.

HMACs are resistant to length-extension attacks & brutes-force attacks.

There must be a #Pepper key used for the HMAC too
Read 16 tweets
Okay, so tomorrow is the day i do the thread on regular expressions. I will do the thread on everything on regexes for 2 popular languages : #Javascript & #Python. So, stay tuned for tomorrows tweets starting at around midday

cc @NellyTadi @Jayydubby @Patrick01_Codes
@NellyTadi @Jayydubby @Patrick01_Codes So sorry for the delay guys;

So, today i am going to be talking about regexs or regular expressions and how formulate them in 2 programming languages. We are going to start with the basics and from there we will look at the meta syntax combinations that come together to make... possible to perform matches on strings (matching sequences) using patterns (formed by meta characters / meta syntax).

Regular Expressions are sequence of characters that define a pattern that is always finite, unambiguous or unaffected by context.
Read 23 tweets
Your MDS Curator this week, @TiffanyTimbers, here.

This morning I would like to share with you some of the most influential resources that have shaped my #DataScience workflow:

1. @swcarpentry 's Version Control with Git lesson:
@TiffanyTimbers @swcarpentry @JennyBryan 3. "Good enough practices in scientific computing" by @gvwilson @JennyBryan Karen Cranston Justin Kitzes @lexnederbragt & @tracykteal…
Read 7 tweets
Why You Should Start Learning Python.

If you like process automation, researching, machine learning, AI, modelling etc...!

You don't need to be a "programmer" before you learn python. You can start today.

What is #Python Programming Language?

Python is a general purpose programming language. Released in 1991.

Python's design philosophy emphasizes code readability with its notable use of significant whitespace.

Its popularity is particularly important in the data science and AI/machine learning fields.
1. Python is easy to learn.

It is good for beginner and you don't really need to worry about functions, datatype and syntax like C/Java etc.

Python is English-like in nature, in fact if you can speak English Language you can write Python 😝😝
Read 10 tweets
Vamos a ver. ¿Cómo se hace un hilo? Estudié física en México hasta la maestría. De ahí crucé el charco para hacer el doctorado en la Universidad de Valencia, España, especializándome en astrofísica. Ahora mismo me encuentro en #Purdue para hacer un posdoc en astrofísica.
Llegué aquí con la beca de @Conacyt_MX para estancias posdoctorales en el extranjero. Tuve un primer año muy productivo. Escribí un código en #fortran e interfaz en #python para evolucionar una distribución de partículas relativistas y monitorear la radiación que estas producían
La finalidad de este código era simular #blazars y #GRB afterglows…

Del modelo para los #blazars se escribió un proyecto con el que se consiguió apoyo del telescopio #FermiLAT de la #NASA. Del de #GRB hay un artículo en camino.
Read 6 tweets
Love the simplicity of #Serverless #FaaS (Function-as-a-Service) but hate the setup process? Look to these 7 open source projects to ease #AWS Lambda deployments:
#BigData #StreamingAnalytics #Cloud #DataScience #MachineLearning #IFTTT #EventDriven #AI
13 free tools for #API design, development, & testing — for example, Amazon API Gateway allows you to build front-end APIs for applications built on Amazon EC2, #AWS Lambda, or any web application:
#microservices #cloud #serverless #FaaS #coding #IoT
#IFTTT alternatives for developers of #EventDriven workflows:
#IoT #EdgeAnalytics #EdgeComputing #Microservices #DataScience #BigData #FaaS #ML
+See the book “AWS Lambda in Action: Event-driven #Serverless Applications” at
Read 4 tweets
A thread about @AcademicChatter and how it works (1/14)
This account exists to facilitate communication, friendship, & support for those working in academia (particularly PhD students and ECR's). Most retweets are automated, though an increasing amount of activity is me @waterlego (Jonathan) (2/14)
The account searches for tweets containing certain academic hashtags and if it finds one, it shares it. After each search the app goes to sleep for approx 10 mins (no activity). When it wakes up it searches again. It does this non-stop (3/14)
Read 14 tweets
Hey all, I’m doing a weekly twitter standup, mostly for myself. But if you or anyone else would like to join, feel free to ping me. I’m thinking a weekly basis won’t be too time consuming. Pick a day of the week, and I’ll @ you to remind you. #weeklytwitterstandup
Did last week:
✅ finally built script to track usage of my servers. It’s a python script uploaded to AWS lambda. The script pings my half-dozen servers for data usage and writes the data onto 1) a MySQL server hosted on AWS RDS, 2) BigQuery database, and 3) google sheets
✅ built a dashboard on server usage data using Tableau public. I now have the dashboard scrolling on my Life Flips app.
Read 31 tweets
Hi #development Twitter & #GCDigital. I'm thinking of creating a gentle #Python-based learning session on how applications work for senior executives. I need your help. Yellow sign -
My hypothesis == w/ hands-on practice of some simple programming fundamentals, senior folks can better understand modern applications, how they are developed & work + the value of #opensource. Maybe some agile.
This, in turn, leads to understanding the art of the possible, better questions on work being done, potentially practical support for building broader #programming & #DataScience capacity in their organizations & more open access to #opensource tools.
Read 8 tweets
#neuroimaging folks, we really need a high-quality #python package or Class to read and work with volumetric and surface atlases. Atlases are central to our work and are still not first class objects!!

I proposed aspects of this few years ago for nilearn:…
I’m trying to deal with different atlases for #graynet :

And it’s not as clean and beautiful as I’d like it to be so far.

Happy to collaborate and work with others to achieve niatlas package.
Atlases shouldn’t be handled on a per-tool or per-ecosystem basis, and we really need a nibabel-like tool dedicated to atlases, with high interoperability across various popular tools.
Read 6 tweets
#Jupyter & #Python people of Twitter, let me know what you think of this:
- Using Jupytext to have my notebooks in percent format, and still be able to work on them as normal notebooks.
- In the code, I have defined classes and functions I might want to import somewhere else
Read 10 tweets

Related hashtags

Did Thread Reader help you today?

Support us! We are indie developers!

This site is made by just three indie developers on a laptop doing marketing, support and development! Read more about the story.

Become a Premium Member ($3.00/month or $30.00/year) and get exclusive features!

Become Premium

Too expensive? Make a small donation by buying us coffee ($5) or help with server cost ($10)

Donate via Paypal Become our Patreon

Thank you for your support!