Update all pip packages that don't come from conda

Question

On my windows 7 system I try to install as many packages using conda. These are easy to update with

conda update all

Unfortunately some packages don't appear in conda but are available through pip and so for those I install them using pip. Updating all pip packages on windows seems more difficult but

for /F "delims===" %i in ('pip freeze -l') do pip install -U %i

is one way I found.

However, this attempts to update all packages, even those installed by conda I believe.

Is there some way to update only those packages installed by pip?

score 9 · Answer 1 · answered Oct 18 '18 at 09:47

9

This is an another simple script using output of conda list which contains list of pip packages.

conda list | grep "<pip>" | cut -d " " -f 1 | xargs pip install --upgrade

answered Oct 18 '18 at 09:47

Ohgyun Ahn

777
1
10
16

3

This worked for me ```conda list | grep "pypi" | cut -d " " -f 1 | xargs pip install --upgrade``` – robbwh Mar 13 '22 at 17:07

score 3 · Answer 2 · answered Sep 29 '17 at 08:50

Here is my attempt at a shell script that will parse the output of conda env export and upgrade any PIP packages:

#!/bin/sh

###############################################################################
# Script to scan an Anaconda environment and upgrade any PIP packages.
#
# Usage:
# $ ./upgrade_pip_packages.sh 
# or explicitly give it an environment file to parse:
# $ ./upgrade_pip_packages.sh <environment.yml file>
#
# Author: Marijn van Vliet <w.m.vanvliet@gmail.com>
#
# Version: 1.0 (29-09-2017)
#   - Initial version of the script.

# Check for optional command line argument
if [ "$#" = 0 ]
then
    ENV_OUTPUT=`conda env export`
elif [ "$#" = 1 ]
then
    ENV_OUTPUT=`cat $1`
else
    echo "Usage: $0 [environment file]" >&2
    exit 1
fi

PIP=0  # Whether we are parsing PIP packages
IFS=$'\n'  # Split on newlines
PIP_PACKAGES=""  # PIP packages found thus far

# Loop over the output of "conda env export"
for line in $ENV_OUTPUT
do
    # Don't do anything until we get to the packages installed by PIP
    if [ "$line" = "- pip:" ]
    then
        PIP=1  # From this point, start doing things.
    elif [[ "$line" = prefix:* ]]
    then
        PIP=0  # End of PIP package list. Stop doing things.
    elif [ $PIP = 1 ]
    then
        # Packages are listed as "   - name==version==python_version"
        # This is a regular expression that matches only the name and 
        # strips quotes in git URLs:
        REGEXP='^  - "\?\([^="]*\)"\?.*$'

        # Find PIP package name (or git URL)
        PIP_PACKAGES="$PIP_PACKAGES `echo "$line" | sed -n "s/$REGEXP/\1/p"`"
    fi
done

# From now on, split on spaces
IFS=' '

echo "The following packages are marked for upgrade using PIP:"
echo
for package in $PIP_PACKAGES
do
    echo " - $package"
done
echo

read -r -p "Shall we proceed with the upgrade? [y/N] " response
case "$response" in
    [yY][eE][sS]|[yY]) 
        # Upgrade each package
        for package in $PIP_PACKAGES
        do
            pip install --upgrade $package
        done
        ;;
    *)
        echo "Aborting"
        ;;
esac

score 1 · Answer 3 · answered Oct 19 '15 at 17:23

1

This is tricky as Pip packages are different than conda packages. Anaconda adds pip as an install choice and puts them in the environment but it does not manage them. Pip is still without an easy command to upgrade all but some suggestions are as you tried and this is another:

pip freeze --local | grep -v '^\-e' | cut -d = -f 1  | xargs pip install -U

answered Oct 19 '15 at 17:23

John Morrison

3,810
1
15
15

Thanks for this but your answer won't work on windows and also doesn't prevent pip from upgrading packages that conda is managing does it? – Simd Nov 10 '15 at 10:03

score 1 · Answer 4 · answered Jan 23 '22 at 20:28

This script (currently Windows only) intersects pip packages reported by conda with pip --outdated output and prints a result like this:

C:\>python.exe pip_updates.py --env base

Querying conda to get pip packages...
Querying pip to get outdated packages...

There are a total of 49 pip (non-conda) packages.
pip reports there are 25 packages that are out of date.
Of those, the non-conda ones are: 6.

Here are the current and latest versions for these 6:
cachetools:         4.2.4 -> 5.0.0
gast:               0.4.0 -> 0.5.3
pylibjpeg:          1.3.0 -> 1.4.0
pylibjpeg-libjpeg:  1.2.0 -> 1.3.0
pylibjpeg-openjpeg: 1.1.1 -> 1.2.0
pylibjpeg-rle:      1.2.0 -> 1.3.0

And here are the pip update commands for those:

pip install cachetools --upgrade
pip install gast --upgrade
pip install pylibjpeg --upgrade
pip install pylibjpeg-libjpeg --upgrade
pip install pylibjpeg-openjpeg --upgrade
pip install pylibjpeg-rle --upgrade

Update all pip packages that don't come from conda

4 Answers4

Linked