Magento 2 - Improved Import / Export extension

Firebear Studio

Last update: Dec 17, 2022

Related tags

Miscellaneous php ecommerce csv cron dropbox ftp csv-files google-drive magento magento-2 dropbox-api magento2 e-commerce magento2-extension ecommerce-store magento2-project magento2-module magento2-import magento2import magento-import

Overview

This is a FREE Improved Import / Export extension. It is by any means NOT a lite, demo or beta version of PAID Improved Import and Export extension. It has completely different code, performace and architecture. If you want to experience the paid version please visit the demo store, or contact Firebear support team.

Magento 2 - Improved Import / Export extension

We’ve started a new project aimed at improving the default Magento 2 import / export functionality. Although this process is significantly refined now, it still lacks some important features; therefore we are developing this Magento 2 extension.

Full version - Improved Import for Magento 2 CE & EE

Improved Import features

Free version features

The free version of Improved Import Magento 2 extension complements native Magento 2 import procedure. The features of the extension are incorporated in the System > Import section. The FREE version of the extension offers the following features:

product images import from Dropbox or via Custom URL and FTP
CSV file import from Dropbox, Custom URL or FTP
debug import in var/log/firebear-import.log
untar / unzip achive with CSV file inside
Supports Magento 2.1, 2.2 and 2.3 versions

Full paid version features

As of now, Improved Import and Export extension is a solid solution for improving Magento 2 import and export processes. The extension offers a complete solution for Magento 2 import/export automation.

The import extension for Magento 2 supports all product types and a number of additional entities such as: categories, CMS pages and blocks, cart price rules, categories, orders. The extension is open code and customizable.

Visit our Magento 2 Open Source Demo store

Or leave a message in the chat to get your hands on the Magento 2 Commerce/Cloud B2B demo store.

Improved Import and Export video overiew

Improved Import & Export Full version features:

CSV, XML, Json, XLSX, ODS file format support

Magento 2 B2B Add-On available for importing and exporting companies, shared catalogs, requisition lists, quotes (abandoned carts) and negotiable quotes

Supported sources: FTP, SFTP, URL, Dropbox and Google Sheets

Use Rest and Soap APIs to connect to the external sources

Import and export scheduling with cron jobs (admin run, CLI)

Powerful import & export attribute and category mapping for any data structure with filters and static values

Import categories, CMS pages, cart price rules, orders, attributes and other entities

Export orders, invoices, shipping data, attributes and other entities

Support all product types, customers, orders

Create configurable products on the fly

Magento 1 and Shopify migration presets

Supports MagMi Magento 1 product files

User friendly & intuitive interface

No programming skills required

Customization endpoints

FREE INSTALLATION AND CONSULTANCY AFTER PURCHASE!

NOW WITH GOOGLE SHEETS SUPPORT

Import products directly from the Google Sheets. Edit the import table with your team or supplier. Paste a link. Hit import button. That's it.

Installation of a Free version

Run:

composer require firebear/importexportfree

php -f bin/magento setup:upgrade

php -f bin/magento setup:static-content:deploy

php -f bin/magento cache:clean

Buy Improved Import for Magento 2 CE & EE

Magento 2 Import Sample files

Full version of Improved Import overview:

The extension introduces import and export jobs - a set of rules that dictate the job when and how to run. The .gif below illustrates the flow of creating and running the job.

For more information about full version of Improved Import and Export extension:

Looking for some specific import feature , modification or connection to Magento 2? - Contact us to discuss and get specific complex import solutions!

Improved Import for Magento 2 upcoming features roadmap

Since we are continuously working on Improved Import features following community and merchant needs, here are upcoming features which we are working on now.

After purchasing the extension, you will receive free upgrades during one year and also will get 50% discount for the second year upgrades! This mean you can purchase extension now to use current features and get free updates with powerful new features!

Continious import / export mapping improvements - merge or separate fileds and import to specific attribute
MS Excel XLSX files native import and mapping - processing of complex Excel files with multiple pages, flexible file files mapping to Magento 2 products , customers and orders striucture
PDF spreadsheet parsing & OpenOffice formats support
CSV mapping import / export presets for Zoey, BigCommerce , WooCommerce , Prestashop, and other major ecommerce systems - to make migration to Magento 2 and sync with the platform extremely easy!
API connection between Magento 2 and Shopify , BigCommerce, and other cloud-based SAAS ecommerce platforms - effortlessly import and export products, customers, and other data on the fly - without creating CSV files! Setup synchronization between your Magento 2 store and other ecommerce platforms in a few clicks;
Improved Import auto-upgrade - built-in system to keep your Improved Import copy up to date and get new import features, bug fix, and patches in Magento 2 instantly!
Import & Export of ALL Magento 2 entites. Custom data structure mapping for categories, customers, discount codes, catalog price rules, CMS pages & static blocks etc. Full flexibility of data import & export to Magento 2!
Product data auto translation during import by Google or Bing - great for import to different store views;
Integration with API of data crawling services, such as https://www.import.io/. Crawl product data from any source and import it directly to Magento 2 - this oppens nearly endless possibilities!
Full covarage by unit and integrations tests
Extension is submitted and will be available soon on Magento Marketplace
API for Magento 2 Import and Improved Import functionality
Auto create configurable product during the import from simple products by SKU pattern
Option to delete / disable products which is not included on CSV file or specific import job
API connection templates to external SAP, ERP, PIM, CRM systems
Combine import / export jobs to queue with dependencies and custom logic between
Multiple files and sources input for one import / export job - merge and split data and files on the fly, advanced data modificators and processors (export only products with stock less than X etc.
Implement all features of MAGMI for Magento 1 - custom images processing, improved speed, advanced data modifications on the import
Import products to Magento 2 from open product catalogs like IceCat etc.
Data feed export presets - easy export products from Magento 2 to major marketplaces and catalogs (eBay, Google Shopping,Google Product Ratings,Amazon Product Ads,Bing Product Ads,Bizrate,Rakuten,AdCell,AlleSchuhe,AllYouNeed,Adform,Adtarget.me,Become,Belboon,Beslist,Billiger.de,BOL,Ciao,Commission Junction,Choozen,Criteo,Dawanda,DooYoo,Facebook,Fruugo,Geizhals,GetPrice,Gimme,Guenstiger.de,Idealo,Junglee,Kelkoo,Kieskeurig,LadenZeile,LeGuide,Monetate,MyShopping.com.au,Nextag,PartnerAds,Pikengo,Polyvore,Preisroboter,PriceGrabber,PriceRunner,PriceSpy,Prisguide,Prisjakt,Pronto,Singlefeed,ShareASale,ShopAlike,ShopCost,Shopping24,Schottenland,ShopMania,Shopwahl,Shopprice,Shopzilla,SoLebIch,Skinflint,Stylight,SuperClix,TheFind,TopPreise,TradeTracker,Tradedoubler,TrovaPrezzi,Twenga,Webgains,Yandex Market,Yatego, Etsy)

Read through Magento 2 Import Guide

##Partner with Firebear Studio Get special discounts, add features to the Improved Import development roadmap and more. Firebear Studio offers partnership opportunities for the development agencies and everyone who is interested in Firebear blog.

Comments

ConsoleOutput in Model/Product causes 500 errors

The Product import model writes to STDOUT through the ConsoleOutput class. This causes the ->writeln calls to be output as headers when importing through the admin panel.

For some installations, this results in a 500 error.

opened by navarr 10
I have the problem with import

I've instaled trial version and when I'm trying to import csv file(your sample) I get the error http://screencast.com/t/fjKnt5F0lYUY How can I see more details about error?

opened by BiletskiyDmitriy 5

Cannot install via Composer on Magento 2.1.7 CE

I tried to install the extension using composer on my project which is Magento 2.1.7 CE.

Got the following errors.

Your requirements could not be resolved to an installable set of packages.

  Problem 1
    - Conclusion: don't install firebear/importexportfree 1.0.3
    - Conclusion: don't install firebear/importexportfree 1.0.2
    - Conclusion: don't install firebear/importexportfree 1.0.0
    - Conclusion: don't install firebear/importexportfree 1.0.3
    - Conclusion: don't install firebear/importexportfree 1.0.2
    - Conclusion: don't install firebear/importexportfree 1.0.0|remove magento/framework 100.1.7
    - Conclusion: don't install firebear/importexportfree 1.0.0|don't install magento/framework 100.1.7
    - Installation request for firebear/importexportfree ^1.0 -> satisfiable by firebear/importexportfree[1.0.0, 1.0.2, 1.0.3].
    - firebear/importexportfree 1.0.0 requires magento/module-import-export 100.0.* -> satisfiable by magento/module-import-export[100.0.2, 100.0.3, 100.0.4, 100.0.5, 100.0.6, 100.0.7].
    - magento/module-import-export 100.0.2 requires magento/framework 100.0.* -> satisfiable by magento/framework[100.0.2, 100.0.3, 100.0.4, 100.0.5, 100.0.6, 100.0.7, 100.0.8, 100.0.9, 100.0.10, 100.0.11, 100.0.12, 100.0.13, 100.0.14, 100.0.15, 100.0.16].
    - magento/module-import-export 100.0.3 requires magento/framework 100.0.* -> satisfiable by magento/framework[100.0.2, 100.0.3, 100.0.4, 100.0.5, 100.0.6, 100.0.7, 100.0.8, 100.0.9, 100.0.10, 100.0.11, 100.0.12, 100.0.13, 100.0.14, 100.0.15, 100.0.16].
    - magento/module-import-export 100.0.4 requires magento/framework 100.0.* -> satisfiable by magento/framework[100.0.2, 100.0.3, 100.0.4, 100.0.5, 100.0.6, 100.0.7, 100.0.8, 100.0.9, 100.0.10, 100.0.11, 100.0.12, 100.0.13, 100.0.14, 100.0.15, 100.0.16].
    - magento/module-import-export 100.0.5 requires magento/framework 100.0.* -> satisfiable by magento/framework[100.0.2, 100.0.3, 100.0.4, 100.0.5, 100.0.6, 100.0.7, 100.0.8, 100.0.9, 100.0.10, 100.0.11, 100.0.12, 100.0.13, 100.0.14, 100.0.15, 100.0.16].
    - magento/module-import-export 100.0.6 requires magento/framework 100.0.* -> satisfiable by magento/framework[100.0.2, 100.0.3, 100.0.4, 100.0.5, 100.0.6, 100.0.7, 100.0.8, 100.0.9, 100.0.10, 100.0.11, 100.0.12, 100.0.13, 100.0.14, 100.0.15, 100.0.16].
    - magento/module-import-export 100.0.7 requires magento/framework 100.0.* -> satisfiable by magento/framework[100.0.2, 100.0.3, 100.0.4, 100.0.5, 100.0.6, 100.0.7, 100.0.8, 100.0.9, 100.0.10, 100.0.11, 100.0.12, 100.0.13, 100.0.14, 100.0.15, 100.0.16].
    - Can only install one of: magento/framework[100.1.7, 100.0.2].
    - Can only install one of: magento/framework[100.1.7, 100.0.3].
    - Can only install one of: magento/framework[100.1.7, 100.0.4].
    - Can only install one of: magento/framework[100.1.7, 100.0.5].
    - Can only install one of: magento/framework[100.1.7, 100.0.6].
    - Can only install one of: magento/framework[100.1.7, 100.0.7].
    - Can only install one of: magento/framework[100.1.7, 100.0.8].
    - Can only install one of: magento/framework[100.1.7, 100.0.9].
    - Can only install one of: magento/framework[100.1.7, 100.0.10].
    - Can only install one of: magento/framework[100.1.7, 100.0.11].
    - Can only install one of: magento/framework[100.1.7, 100.0.12].
    - Can only install one of: magento/framework[100.1.7, 100.0.13].
    - Can only install one of: magento/framework[100.1.7, 100.0.14].
    - Can only install one of: magento/framework[100.1.7, 100.0.15].
    - Can only install one of: magento/framework[100.1.7, 100.0.16].
    - Installation request for magento/framework (locked at 100.1.7) -> satisfiable by magento/framework[100.1.7].

After inspecting the the module's composer.json file, it seems that it is dependent on magento/module-import-export version range 100.0.*, and the Magento 2.1.7 CE has the magento/module-import-export version at 100.1.4.

Is the module compatible with latest magento versions ?

opened by atish2jcommerce 3

Fixed wrong method call when saving product entity (Magento CE 2.1.1)

Method _saveProductEntity doesn't exist in Magento Community Edition 2.1.1, which leads to errors when importing products.

The erroneous method call has been corrected. This bug also exists in the paid version of the module.

see https://github.com/firebearstudio/importexport/pull/3

opened by mashb1t 3
Incompatible with PHP 7.1
Currently requires:

php: ~5.5.0|~5.6.0|~7.0.0

So it's throwing:

[InvalidArgumentException] Could not find package firebear/importexportfree at any version matching your PHP version 7.1.10.0

Is this because of breaking changes in the new PHP version or just the requirement on the package hasn't been updated to 7.1?
opened by stu177 2
error in compiling

Hi,

The module gives me the error below, when I try to compile it:

Fatal error: Cannot use Magento\Framework\Module\Dir\Reader as Reader because the name is already in use in /xxxxxxxxxxxxxxx/public_html/vendor/firebear/importexportfree/Model/Source/Config/SchemaLocator.php on line 10

Fatal error: Cannot use Magento\Framework\Module\Dir\Reader as Reader because the name is already in use in /xxxxxxxxxxxxxxxx/public_html/vendor/firebear/importexportfree/Model/Source/Config/SchemaLocator.php on line 10

Any ideas?

thanks

opened by idedooij 2
app/code/Firebear/ImportExport/Model/Source/Config/SchemaLocator.php on line 10

Sorry to raise this issue again (I have seen it under the closed issues). I downloaded the lastest version, but I still get this error when I go to import section in my Magento admin.

thanks, iwan

opened by idedooij 2
Override of the import validation

We have a system currently using the import export module. When the csv validation has issues not from the FireBear validation but from the standard Magento import validation process these will get overridden.

In the Firebear\ImportExport\Model\Job\Processor::process method when it catches an exception it will load the history and set the summary. But the Magento validation has already added the appropriate log messages to the history for this process. The end result is that when you get <b>Data validation is failed. Please fix errors and re-upload the file..</b> in the summary and not the "real" error message as provided by the Magento core import validation.

opened by dmanners 2
Order history & cache for updated products
I'm looking into buying the extension. Two questions:

Can you explain the flow regarding the cache: what will customers see during the import: will the performance of the shop degrade during import?

If products and categories are updated; will the order history, e.g. the info a customer can lookup about their orders, always stay intact?
opened by acidjunk 2
SFTP DOES NOT SUPPORT. PLEASE SEE CODE BELOW TO MAKE SFTP TO WORK

step1 : add new file to following location: Firebear\ImportExport\Model\Filesystem\Io => Sftp.php
_conn, $filename); } } **step2 :** add test case to Firebear\ImportExport\Test\Unit\Model\Source\Type => SftpTest.php objectManagerHelper = new ObjectManagerHelper($this); $this->_sftpClient = $this->getMockBuilder('Firebear\ImportExport\Model\Filesystem\Io\Sftp') ->setMethods( [ 'read' ] ) ->getMock(); $this->_sftpClient->expects($this->any()) ->method('read') ->willReturn(true); $this->varDirectory = $this->getMock( 'Magento\Framework\Filesystem\Directory\Write', ['getAbsolutePath'], [], '', false ); //$this->varDirectory->expects($this->any())->method('getAbsolutePath')->will($this->returnValue(true)); $this->filesystem = $this->getMock( 'Magento\Framework\Filesystem', ['getDirectoryWrite'], [], '', false ); $this->filesystem->expects($this->any())->method('getDirectoryWrite')->willReturn($this->varDirectory); $this->factory = $this->getMock('Magento\Framework\Filesystem\File\ReadFactory', [], [], '', false); $this->scopeConfigInterface = $this->getMock('Magento\Framework\App\Config\ScopeConfigInterface'); $this->_sftpMock = $this->objectManagerHelper->getObject( 'Firebear\ImportExport\Model\Source\Type\Sftp', [ 'scopeConfig' => $this->scopeConfigInterface, 'filesystem' => $this->filesystem, 'readFactory' => $this->factory ] ); $this->_sftpMock->setClient($this->_sftpClient); // $this->_ftpMock = $this->getMockBuilder('Firebear\ImportExport\Model\Source\Type\Ftp') // ->setConstructorArgs( // [ // $this->getMockBuilder('Magento\Framework\App\Config\ScopeConfigInterface') // ->disableOriginalConstructor() // ->getMock(), // $this->getMockBuilder('Magento\Framework\Filesystem') // ->disableOriginalConstructor() // ->getMock(), // $this->getMockBuilder('Magento\Framework\Filesystem\File\ReadFactory') // ->disableOriginalConstructor() // ->getMock(), // ] // ) // ->setMethods( // [ // 'uploadSource', // '_getSourceClient', // ] // ) // ->getMock(); // // $this->_ftpMock->expects($this->any()) // ->method('_getSourceClient') // ->willReturn($this->_ftpClient); $this->_sftpMock->setData('import_source', 'sftp'); $this->_sftpMock->setData('sftp_file_path', '/public_html/import/products_2_replace.csv'); } public function testUploadSource() { try { $result = $this->_sftpMock->uploadSource(); } catch (\Exception $e) { $result = $e->getMessage(); } $this->assertEquals('/var/www/local-mage2dev.com/magento2/var/import/sftp/products_2_replace.csv', $result); } } **step3:** add sftp source to Firebear\ImportExport\Model\Source\Type => Sftp.php */ namespace Firebear\ImportExport\Model\Source\Type; class Sftp extends AbstractType { /** * @var string */ protected $_code = 'sftp'; /** * Download remote source file to temporary directory * * @return string * @throws \Magento\Framework\Exception\LocalizedException */ public function uploadSource() { if($client = $this->_getSourceClient()) { $sourceFilePath = $this->getData($this->_code . '_file_path'); $fileName = basename($sourceFilePath); //return get_class($this->_directory); $filePath = $this->_directory->getAbsolutePath($this->getImportPath() . '/' . $fileName); $filesystem = new \Magento\Framework\Filesystem\Io\File(); $filesystem->setAllowCreateFolders(true); $filesystem->checkAndCreateFolder($this->_directory->getAbsolutePath($this->getImportPath())); $result = $client->read($sourceFilePath, $filePath); if($result) { return $this->_directory->getAbsolutePath($this->getImportPath() . '/' . $fileName); } else { throw new \Magento\Framework\Exception\LocalizedException(__("File not found")); } } else { throw new \Magento\Framework\Exception\LocalizedException(__("Can't initialize %s client", $this->_code)); } } /** * Download remote images to temporary media directory * * @param $importImage * @param $imageSting * * @throws \Magento\Framework\Exception\LocalizedException */ public function importImage($importImage, $imageSting) { if($client = $this->_getSourceClient()) { $sourceFilePath = $this->getData($this->_code . '_file_path'); $sourceDirName = dirname($sourceFilePath); $filePath = $this->_directory->getAbsolutePath($this->getMediaImportPath() . $imageSting); $dirname = dirname($filePath); if (!is_dir($dirname)) { mkdir($dirname, 0775, true); } if($filePath) { $result = $client->read($sourceDirName . '/' . $importImage, $filePath); } } } /** * Check if remote file was modified since the last import * * @param int $timestamp * @return bool|int */ public function checkModified($timestamp) { if($client = $this->_getSourceClient()) { $sourceFilePath = $this->getData($this->_code . '_file_path'); if(!$this->_metadata) { $this->_metadata['modified'] = $client->mdtm($sourceFilePath); } $modified = $this->_metadata['modified']; return ($timestamp != $this->_metadata['modified']) ? $modified : false; } return false; } /** * Prepare and return SFTP client * * @return \Firebear\ImportExport\Model\Filesystem\Io\Sftp * @throws \Magento\Framework\Exception\LocalizedException */ protected function _getSourceClient() { if(!$this->getClient()) { if($this->getData('host') && $this->getData('port') && $this->getData('user') && $this->getData('password')) { $settings = $this->getData(); } else { $settings = $this->_scopeConfig->getValue( 'firebear_importexport/sftp', \Magento\Store\Model\ScopeInterface::SCOPE_STORE ); } $settings['passive'] = true; try { $connection = new \Firebear\ImportExport\Model\Filesystem\Io\Sftp(); $connection->open( $settings ); $this->_client = $connection; } catch(\Exception $e){ throw new \Magento\Framework\Exception\LocalizedException(__($e->getMessage())); } } return $this->getClient(); } } **step 4:** add source types to /Firebear/ImportExport/etc/ => source_types.xml
step5 : change config.xml : 22

step6: add sftp config settings: user should be username, not 'user' SFTP Host Port Username Password You will be able to define file path during import/export process

this makes sftp available and product import works with sftp.

FIREBEAR:No one using ftp now days and not secure. Please start adding some secure points to module if you build and sell it. We bought it and finally added our own code to work.

Uploading sftp.zip…

opened by nagrgk 2
import hang

Hello, after enabling your module on my dev magento2 when I try to import the please wait hang forever,

I´m using the free version, all work fine when I disable the module

opened by to8gal 2
No creating new color attribute values

Value for 'color' attribute contains incorrect value, see acceptable values on settings specified for Admin. For SKU: "x" in rows: 2387, 2604, 2605

opened by joepperkins 0
Export feature

The module title and description implies having export functionality, however the code seems to have no such feature. Advertising an export that doesn't export.

opened by aliomattux 0
Fatal Error

Hi Team I have installed the Extention it is not working getting an error My Magento Version: 2.3.4

Fatal error: Uncaught Error: Call to a member function getSchema() on null in /home/adaecas1/dev.hollandandbarrett.es/vendor/firebear/importexportfree/Model/AbstractReader.php:47 Stack trace: #0 /home/adaecas1/dev.hollandandbarrett.es/vendor/magento/framework/ObjectManager/Factory/AbstractFactory.php(121): Firebear\ImportExport\Model\AbstractReader->__construct(Object(Magento\Framework\App\Config\FileResolver), Object(Magento\Framework\App\Arguments\ValidationState), Array, 'Magento\Framewo...', 'global', '', NULL, NULL) #1 /home/adaecas1/dev.hollandandbarrett.es/vendor/magento/framework/ObjectManager/Factory/Compiled.php(108): Magento\Framework\ObjectManager\Factory\AbstractFactory->createObject('Firebear\Import...', Array) #2 /home/adaecas1/dev.hollandandbarrett.es/vendor/magento/framework/ObjectManager/Factory/Compiled.php(150): Magento\Framework\ObjectManager\Factory\Compiled->create('Firebear\Import...') #3 /home/adaecas1/dev.hollandandbarrett.es/vendor/magento/framework/ObjectManager/Factory/Compiled.php(79): Mag in /home/adaecas1/dev.hollandandbarrett.es/vendor/firebear/importexportfree/Model/AbstractReader.php on line 47

opened by anzi121 1
Issue - Name Field Required on import.

Hello, Not sure if you guys are still actively upgrading this, found a issue. When importing(Add/Update) while not using the Name field will receive the following error. Undefined index: name in /home/gamehead/public_html/vendor/firebear/importexportfree/Model/Import/Product.php on line 396

SKU should be the only required column when importing. Using very basic .csv file of just SKU - QTY column produces error. When added Name column issue is resolved.

opened by Raged23 0
Allowed memory size of 1610612736 bytes exhausted

I am just running this command in ssh to install firebearimportexportfree extension but i am getting this error in ssh

Fatal error: Allowed memory size of 1610612736 bytes exhausted (tried to allocate 4096 bytes) in phar:///opt/cpanel/composer/bin/Composer/DependencyResolver/Solver.php on line 223

Check http://getcomposer.org/doc/articles/troubleshooting.md#memory-limit-errors for more info on hove to handle out memory errors.hostname.com

which is about Memory limit but my memory limit is already 1024M look this

SSH image

opened by atulcodex 1

Releases(v1.1.0)

v1.1.0(Dec 12, 2019)

Source code(tar.gz)
Source code(zip)
v1.0.3(Jan 21, 2017)

Source code(tar.gz)
Source code(zip)
v1.0.0(Apr 7, 2016)
Free version The free version of Improved Import offers the following features:

product images import from Dropbox or via Custom URL and FTP

csv file import from Dropbox or via Custom URL and FTP

Source code(tar.gz)
Source code(zip)