Posts

Showing posts with the label Notebooks

Datalab: Running notebooks against large datasets

Image
How Datalab: Running a notebook against a large dataset Streaming your big data into your local computer environment is slow and expensive. In this episode of AI Adventure, we'll take a look at how to bring a notebook environment to your database! What's better than an interactive Python notebook? An interactive Python notebook with fast and easy data connectivity, of course! We saw how useful Jupiter notebooks are. This time we will see how to take it further by running it in the cloud with many extra goodies. Data, but big When you work with larger and larger datasets in the cloud, it becomes increasingly unnecessary to interact using your local machine. It is difficult to download statistically representative samples of data to check your code and rely on data streaming a stable connection to train locally. So what should a data scientist do? If you can't bring data to your computer, bring your data to your computer! Let's see how we can run a notebook environment in

Data Science with Jupyter Notebooks

Image
Interactive data science with Jupyter notebook The way I run Python code live on the screen is by using a Python package called Jupiter. Jupyter is built into the IPython project and allows Interactive Python to run in your browser. But it is more than that. From special command "magic" and bash commands to plugins, Jupiter greatly enhances the Python coding experience. If you are already using Jupiter, I hope I can improve your workflow and show you some new tricks. If you are not yet using Jupyter, then log in. Installation and startup The easiest way to install Jupiter is to install the pipe using Jupiter, although if you use a package Python distribution like Anacondo, you may have already installed it. Be sure to activate your Python environment first. We dive. When you turn on Local Jupyter, you'll connect to a locally running webserver through your browser, usually on the 8888 port. Start your notebook by running Jupiter Notebook in your work directory. Normally Ju