Import pipe ('|') delimited file

If you have questions or if you want to share your opinion about Aware IM post your message on this forum
Post Reply
Jhstephenson
Posts: 297
Joined: Wed Apr 22, 2015 11:44 pm

Import pipe ('|') delimited file

Post by Jhstephenson »

I am new at using AwareIM so I am sure this is something I am overlooking, but I have run into something that seems odd to me.

I am importing a pipe ( | ) delimited file that should bring in a little over 9000 records. However it is only bringing in a little over 1000 records. The reason that I am using a pipe character is because some of the text strings in the table have double quotes and commas in them. I have an import template defined with the '|' character as the delimiter. It identified the correct number of columns and they have all been matched to attributes in the business object.

When I look at the import log it shows the following:

Importing business object Part
37 Record for row 1 imported successfully
37 Record for row 2 imported successfully
37 Record for row 3 imported successfully
37 Record for row 4 imported successfully
37 Record for row 5 imported successfully
37 Record for row 6 imported successfully
37 Record for row 7 imported successfully
37 Record for row 8 imported successfully
37 Record for row 9 imported successfully
37 Record for row 10 imported successfully
37 Record for row 11 imported successfully
37 Record for row 12 imported successfully
37 Record for row 13 imported successfully
37 Record for row 14 imported successfully
37 Record for row 15 imported successfully
37 Record for row 16 imported successfully
37 Record for row 85 imported successfully
37 Record for row 87 imported successfully
.........
.........

This seems to indicate that it skipped rows 17 to 84. There are other gaps like this in the log further down.
From what I can tell, the records that were not imported all have a double quote in at least one of the text strings.

Below is what the first 87 records, plus the header look like.
Anyone have any ideas?
Jim

==================================================================================================================================
"Description"|"SerialNumber"|"Category"|"Vendor"|"Customer"|"CustomerDepartment"|"DateOrdered"|"DateReceived"|"DateDelivered"|"DateInvoiced"|"VendorInvoice"|"SccInvoice"|"Quantity"|"Cost"|"WarrantyPeriodYears"|"WarrantyPeriodDays"|"ItemNumber"
| |CD WRT| |00000| | | | | | | |000000.00|0000000000.00|00|000|0003639
| |SWITCH| |00000| | | | | | | |000001.00|0000000000.00|00|000|0004044
| |CARD | |00000| | | | | | | |000003.00|0000000000.00|00|000|0005483
| | | |00000| | | | | | | |000000.00|0000000000.00|00|000|0006754
| |ADAPT | |00000| | | | | | | |000001.00|0000000000.00|00|000|0006781
| | | |00000| | | | | | | |000000.00|0000000000.00|00|000|0007566
| | | |00000| | | | | | | |000000.00|0000000000.00|00|000|0007989
| | | |00000| | | | | | | |000000.00|0000000000.00|00|000|0008272
| | | |00000| | | | | | | |000000.00|0000000000.00|00|000|0008282
| | | |00000| | | | | | | |000000.00|0000000000.00|00|000|0008553
| |TABLET| |00000| | | | | | | |000000.00|0000000000.00|00|000|0008950
| | | |00000| | | | | | | |000000.00|0000000000.00|00|000|0009146
|S792RLKN | | |00000| | | | | | | |000000.00|0000000000.00|00|000|0000000
|SSSS | | |00000| | | | | | | |000000.00|0000000000.00|00|000|0000000
16/8 BIT 10 BASE -T NE2000 ETHERNET HUB |EGA1505524 |HUBS |CPU |00000| | | | | | | |000000.00|0000000000.00|00|000|0001559
3RD INSTALLMENT - HEALTH DEPT PROGRAM |N/A | | |00000| | | | |02/04/2002| |02-090 |000000.00|0000000000.00|00|000|0002463
APC "REPLACEMENT" BATTERY (SU700XL UPS UNIT) | |BATTER| |00000| | | | | | | |000000.00|0000000000.00|00|000|0005988
APC SMART 700VA UPS UNIT |QS0317120910 |UPS | |00000| | | | | | | |000000.00|0000000000.00|00|000|0003301
ATEK REMOTECONTROL/LASER POINTER | | | |00000| | | | | | | |000000.00|0000000000.00|00|000|0003012
BARCODE READER "IDAUTOMATION" - USB (3482-47 |UNAVAILABLE |BAR CO| |00000| | | | | | | |000000.00|0000000000.00|00|000|0003948
BARCODE READER - "IDAUTOMATION", USB (3482-47) |UNAVAILABLE |BAR CO| |00000| | | | | | | |000000.00|0000000000.00|00|000|0003947
BATTERY - FOR THINKPAD 600 | |PORTA | |00000| | | | | | | |000000.00|0000000000.00|00|000|0004042
BATTERY - LAPTOP (H.P. ZT1135 | |BATT | |00000| | | | | | | |000000.00|0000000000.00|00|000|0003977
BATTERY, 10.8 VOLT - FOR TRANSPORT GX3 | |BATT | |00000| | | | | | | |000000.00|0000000000.00|00|000|0006007
BELKIN 800VA 6-OUTLET "UPS UNIT" |3X023747765W70 | | |00000| | | | | | | |000000.00|0000000000.00|00|000|0002937
BENQ 16X DVD-ROM |4305690SDYOOD | | |00000| | | | | | | |000000.00|0000000000.00|00|000|0002916
CABLE RACK MANAGERS (2) | | |CDW |00000| | | | |09/16/2009| |09-482 |000002.00|0000000000.00|00|000|0006114
CIRCUIT BOARDS (MATROX) - QID-P256PRO (2 OF 3) |KFJ31416,KFJ82030 |CIRCUI| |00000| | | | | | | |000000.00|0000000000.00|00|000|0006042
CITY SURVEYS - 60.5 HRS | | | |00000| | | | |01/16/2006| |06-26 |000000.00|0000000000.00|00|000|0004325
CLI 5250 | | | |00000| | | | | | | |000000.00|0000000000.00|00|000|0000681
CLI DISPLAY |6000131 |DISPLA| |00000| | | | | | | |000000.00|0000000000.00|00|000|0000758
CREATIVE LABS | | | |00000| | | | | | | |000000.00|0000000000.00|00|000|0000000
CREDIT MEMO - RETURNED A | | | |00000| | | | | | | |000000.00|0000000000.00|00|000|0003598
D | | | |00000| | | | | | | |000000.00|0000000000.00|00|000|0005870
D-LINK, 10/100, 24-PORT, "SWITCH" |C20413B002198 |SWITCH|D&H |00000| | | | |03/12/2004| |04-133 |000000.00|0000000000.00|00|000|0003435
D-LINK, PRINT SERVER |P16R195000148 |PRINT | |00000| | | | | | | |000000.00|0000000000.00|00|000|0006169
DATAMAX E4205 LABEL PRINTER, PEEKER & CUTTER |N/A-END OF FISCAL YR|PRINT | |00000| | | | | | | |000000.00|0000000000.00|00|000|0007568
DELKIN SMARTMEDIA USB CARD READERS | | | |00000| | | | | | | |000000.00|0000000000.00|00|000|0002905
DELL - CPX, PIII, LAPTOP COMPUTER |DN1RG01 |COMP | |00000| | | | | | | |000000.00|0000000000.00|00|000|0004068
DELL OPTIPLEX, 740 COMPUTER | | | |00000| | | | | | | |000000.00|0000000000.00|00|000|0005319
DELL POWER EDGE 2400 "SERVER" | | | |00000| | | | | | | |000000.00|0000000000.00|00|000|0000000
DELL VOSTRO 1500 LAPTOP | | | |00000| | | | | | | |000000.00|0000000000.00|00|000|0005309
DISK UNITS - (4) 8GB DISKS (REPLACED 3-4GB) |UNAVAILABLE | | |00000| | | | | | | |000000.00|0000000000.00|00|000|0002656
DVI-VGA ADAPTERS (2) | |ADAPT | |00000| | | | | | | |000000.00|0000000000.00|00|000|0004673
EPADLINK, SIGNATURE PADS - "9" | |SIGN | |00000| | | | | | | |000000.00|0000000000.00|00|000|0008100
FELLOWS - PREMIUM ARTICULATING KEYBOARD TRAYS (2) | | | |00000| | | | | | | |000000.00|0000000000.00|00|000|0003484
FROUTER, 4-PORT, W/VPN |UNAVAILABLE |BEST |BEST BUY|00000| | | | | | | |000000.00|0000000000.00|00|000|0003408
FUJITSU - SCANNER MODEL M4097D |002856 |SCAN |AVNET |00000| | | | |09/29/2000| | |000000.00|0000000000.00|00|000|0000000
FUJITSU, SCSI, 36GB, HARD DRIVE |UNAVAIABLE |COMPU | |00000| | | | | | | |000000.00|0000000000.00|00|000|0004986
FUJITSUM SCSI, 36GB, HARD DRIVE |UNAVAILABLE |HARD | |00000| | | | | | | |000000.00|0000000000.00|00|000|0004987
GWAVA LICENSES & UPGRADE/TECH SUPPORT (1,000 LICENSE) |JB5CVYDP |SOFT | |00000| | | | | | | |000000.00|0000000000.00|00|000|0003565
GWAVA LICENSES, UPGRADE/TECH SUPPORT (1,000 LICENSES) |JB5CVYDP |SOFT | |00000| | | | | | | |000000.00|0000000000.00|00|000|0003566
HARD DRIVE, (FUJITSU), 73GB, SCSI |UNAVAILABLE |DISCOU| |00000| | | | | | | |000000.00|0000000000.00|00|000|0005249
HEWLETT PACKARD DESKJET 690C PRINTER |MY6A31T07X |PRINTE| |00000| | | | | | | |000001.00|0000000000.00|00|000|0001044
HEWLETT-PACKARD LASERJET 1300 PRINTER |SCNCB832922 |PRINT | |00000| | | | | | | |000000.00|0000000000.00|00|000|0003633
HEWLETT-PACKARD LASERJET 1320 PRINTER |SCNDC522346 |PRINT |D&H |00000| | | | |07/28/2005| |05-363 |000001.00|0000000000.00|00|000|0004057
HEWLETT-PACKARD LASERJET PRINTERS |414016/414030 |PRINTR|MINT |00000| | | | | | | |000000.00|0000000000.00|00|000|0001068
HEWLETT-PACKARD OFFICEJET 8600 ALL-IN-ONE |CN1A51S17 | | |00000| | | | | | | |000000.00|0000000000.00|00|000|0007243
IBM "USED" MICROCHANNEL CARD (CAME FROM DANA'S OLD PC) |N/A |CARD | |00000| | | | | | |98-20 |000000.00|0000000000.00|00|000|0001403
IBM 419GB "DISK UNITS" (2) |167CF62/68252DFO | | |00000| | | | | | | |000000.00|0000000000.00|00|000|0002389
IBM 419GB DISK UNITS (2) |167CF62/68252DFO |DISK | |00000| | | | | | | |000000.00|0000000000.00|00|000|0002388
IBM 940X-6383, 16GB, "TAPE DRIVE" |N1910087387 |DR.IBM|AVNET |00000| | | | |02/24/2005| |05-085 |000001.00|0000000000.00|00|000|0003862
IBM SERVICE - MAINTENANCE |N/A |MAINT |IBM |00000| | | | |08/10/2000| |00-379 |000000.00|0000000000.00|00|000|0001824
INTERNAL CD-RW |16A9502S211 | | |00000| | | | | | | |000000.00|0000000000.00|00|000|0002281
J HOOK WALL MOUNTS & VELCRO | | | |00000| | | | | | | |000000.00|0000000000.00|00|000|0008660
KINSTON, 2GB SECURE DISGITAL CARDS (3) | | |D&H |00000| | | | |07/09/2008| |08-341 |000000.00|0000000000.00|00|000|0000000
LANTASTIC "ISHARE" (32 USER) UPGRADE SOFTWARE |N/A |SOFTWA|ARTISOFT|00000| | | | | | | |000000.00|0000000000.00|00|000|0000000
LAPTOP BATTERY (H.P. ZT1135) | |BATT | |00000| | | | | | | |000000.00|0000000000.00|00|000|0003976
LEX OPTRA R+ 500 SHEET DRAWERS | |DRAWER|DRAWERS |00000| | | | | | | |000000.00|0000000000.00|00|000|0000538
LEXMARK | | | |00000| | | | | | | |000000.00|0000000000.00|00|000|0008650
LEXMARK (REFURB) OPTRA 520N PRINTER |UNAVAIL/DROP SHIP |PRINT | |00000| | | | | | | |000000.00|0000000000.00|00|000|0004306
LINSYS NAS STORAGE 10/100 MBPS |UNAVAIL/DROP SHIPPED| | |00000| | | | | | | |000000.00|0000000000.00|00|000|0003675
LOST PASSWOR - WORDPERFECT | | | |00000| | | | | | | |000000.00|0000000000.00|00|000|0004910
LOST PASSWORD | | | |00000| | | | | | | |000000.00|0000000000.00|00|000|0004909
M | | | |00000| | | | | | | |000000.00|0000000000.00|00|000|0003162
MAGIC SOFTWARE |6128113385 |SOFT |MAGIC |00000| | | | |01/17/1995| |95-26 |000000.00|0000000000.00|00|000|0001661
MAGIC SOFTWARE "UPGRADE" TO V9.4 (35-USER) OPEN CLIENT |527242776 |SOFT |MAGIC |00000| | | | |04/20/2004| |04-193 |000000.00|0000000000.00|00|000|0003493
MAGIC SOFTWARE (5-USER) V9.4 |727286294 |SOFT |MAGIC |00000| | | | | | | |000000.00|0000000000.00|00|000|0003607
MAGIC SOFTWARE - (5-USER) V9.4 APPLICATION LICENSES |727286294 |SOFT |MAGIC |00000| | | | | | | |000000.00|0000000000.00|00|000|0003606
MAGIC SOFTWARE, V9.4, 50-USER OPEN CLIENT (35 TO 50) |727242764 |SOFT |MAGIC |00000| | | | |05/20/2005| |05-251 |000050.00|0000000000.00|00|000|0003989
MCAFEE INTERNET SECURITY SUITE + 1 | |SOFT | |00000| | | | | | | |000000.00|0000000000.00|00|000|0005046
MEMORY - (USED), 1-128 MB | | | |00000| | | | |06/27/2006| |06-348 |000001.00|0000000000.00|00|000|0004544
MEMORY KIT .. 2 | | | |00000| | | | | | | |000000.00|0000000000.00|00|000|0007230
MICR TONER - LEXMARK 4049 |N/A |SUPLLY| |00000| | | | | | | |000000.00|0000000000.00|00|000|0000000
MICRON 15" LCD/FLAT MONITOR |F1525S008713 |MONITR|MICRON |00000| | | | |11/25/2003|NO SCAN |03-583 |000000.00|0000000000.00|00|000|0003299
MICRON 17" COLOR MONITOR |0137V11H72440 |MONITO|MICRON |00000| | | | |06/12/2000| |00-301 |000000.00|0000000000.00|00|000|0001777
MICRON 17" LCD MONITOR |F1725S000396 |MONITR|MICRON |00000| | | | |03/28/2003| |03-162 |000000.00|0000000000.00|00|000|0003052
=================================================================================================================
customaware
Posts: 2413
Joined: Mon Jul 02, 2012 12:24 am
Location: Ulaanbaatar, Mongolia

Re: Import pipe ('|') delimited file

Post by customaware »

Hi Jim,

Sent sample with some notes on changes.

Seems like Excel added a character (I suspect a Tab) before and after the '|' so I stripped those out. Also the serial number needs to be 30 chars instead of
20.

Demo also created the Reference Link between your Client BO and the Child parts on the fly.

Hope that helps
Cheers,
Mark
_________________
AwareIM 6.0, 8.7, 8.8, 9.0 , MariaDB, Windows 10, Ubuntu Linux. Theme: Default, Browser: Arc
Upcloud, Obsidian....
Image
Post Reply