Do folks often use Jupyter notebook outside of Databricks? I wonder if this is a common scenario to save costs across different cloud vendors.
e.g. https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/python/jupyter-notebook What do others think? |
I’ve only used a few hosted ones from time to time, and now I host my own (private) jupyterhub for various reasons.
My POV comes from academia. Our data is rarely in any sort of database, and is often just in various files we have to parse or otherwise ingest and analyze. So the notebooks tend to live next to the data (on our laptop or maybe a group server).
As an aside, academics often have a very hard time paying for services. Universities want to get involved in any sort of recurring subscription, get the legal department to look at the contracts, maybe even negotiate, etc. This is true even for $10/month. So we often look to do things locally ("shadow IT" is kind of a related phenomenon).
However, researchers and data analysts in private industry probably have a very different way of working, so don't take this as gospel. But as for your original question, yes, many many scientists use jupyter locally.