Neil Kelly nialloceallaigh

## description.md

      
        
          
            
              
              2 files
            
          
          
            
              
              5 forks
            
          
          
            
              
              10 comments
            
          
          
            
              
              19 stars
            
          
        
        
          
              
          
          
            
                mangecoeur
                / description.md
            
            
              Last active
              March 30, 2021 21:34
            
              
                Pandas PostgresSQL support for loading to DB using fast COPY FROM method
              
          
        
      
        
  
      
    This small subclass of the Pandas sqlalchemy-based SQL support for reading/storing tables uses the Postgres-specific "COPY FROM" method to insert large amounts of data to the database. It is much faster that using INSERT. To acheive this, the table is created in the normal way using sqlalchemy but no data is inserted. Instead the data is saved to a temporary CSV file (using Pandas' mature CSV support) then read back to Postgres using Psychopg2 support for COPY FROM STDIN.