How to import 50'000 mailing targets ?

[ybollati]

Hi,
I am trying to run a mailing with about 50'000 emails. The emails are in a big CSV file.

The targets import function work well but it hangs at around 1'500 entries. I guess the job is too big to run in a web page.

Can somebody tell me how to load those 50'000 targets properly ??? Is there a command line import script somewhere ??

Anybody has experience with such large mailing campaign with SugarCRM ?

50'000 is a starting point for me, my next mailings will be in hundreds of thousands at least...

If SugarCRM can't handle this kind of volume, any suggestion for an open source tool with similar mailing features ?

NB: I am running my own servers.

Thanks

Yannick

[oobat]

I can't help your problem, as I don't know what the problem is, but I can only hope that these are Opt-In mailings. If you're the beginning's of another spammer I think I'll scream.


Craig

[ravindram]

Hi,
I am trying to run a mailing with about 50'000 emails. The emails are in a big CSV file.

The targets import function work well but it hangs at around 1'500 entries. I guess the job is too big to run in a web page.

Can somebody tell me how to load those 50'000 targets properly ??? Is there a command line import script somewhere ??

.....
Yannick

Hi,

You can do it in SugarCRM easily. I think you need to modify the PHP.ini and my.ini files and also config.php files for this.

If you post your files here, i will help you out how to import all those targets into SugarCRM.

But in general we import records as sets of 1000 only as it is easy to maintain and allocate those to users easily.

[ybollati]

Sure they are opt-in emails. I am not a spamer...

I will look at the php.ini setup and see if I need more help...

What are the largest mailings people do with SugarCRM ?? Any experience with 100'000 emails ? 500'000 emails ???

The bigest issue I see is how to properly manage all those "targets" in a clever way. The easiest for me would probably be to create a direct link between the "prospects" table and my operational database were all the criterias are available.

Is there any details available how the "prospects" table works ?

For instance I need maintain the targets in sync with my production database. The only way I can make sure that my targets are correct and "fresh" is to delete them all and re-load them all. But I can't find a nice way to delete several thousands of targets simply. The only way I found is to go straight in the MYSQL prospects table and run a UPDATE query to set all deleted field to true but that's not very practicale and safe. The prospects table will also growth very large quickly...

I looked at salesforce.com and they don't recommand to use their mailing campaign module for any large size mailing....

Would you recommand any other open source tool with similar functionality for mailing campaigns that can manage very large lists ?

Thanks...

Yannick

[ybollati]

Made some progress on the importing limitations.

In fact it seems that the issue with the import process is the memory size.

To import 5000 targets the PHP process growth up to 190 MB of RAM !!

Increazing memory_limit to 500 MB we were able to import 8000 contacts.

The problem is that SugarCRM run on the server where I also have other public PHP processes so I can't play with memory_limit too much because this will create serious security issues elsewhere.

Yannick

[ybollati]

I run my first emailing with about 40'000 emails and it went fine.

It tooks a few hours to get emails out but no issues.

Yannick

[jonas33432]

well guys - I spitted out 170.000 email. Slow outbound, but we did it. That was great.
What was NOT so great thats the import.
So we splitted 172.000 CSV file in excel in to about 1000 (probably 870 - don't rememnber exctl) records file each (sic!) and .. that was it.
Works.

Import REQUIRES be improved, but kids games like 2-3K list is OK.
BTW - import was made to LEADS.
HW:
HP DL 385 2xOpteron + 2GB Ram + scsi HD's all on SuSE SLES9

[akash.bhunchal]

i faced the same problem. There is no limit to sugarcrm when it somes to uploading a CSV (containing your contacts or leads). But you need to change the following parameters (you might not able to do so coz of security reasons but this is the way i made it to work). I am currently importing 1500000 leads into sugar .... it has already uploaded 100000 and is still going on .

PHP.ini:
max_execution_time = 3000000000 ; Maximum execution time of each script, in seconds
max_input_time = 600000000 ; Maximum amount of time each script may spend parsing request data
memory_limit = 500M ; Maximum amount of memory a script may consume (128MB)
post_max_size = 300M
upload_max_filesize = 300M

in the admin of sugar go to system settings, there is a variable which limits the size of the file uploaded . Make it a huge number.

Now upload ... It will work like a charm. Incase you still face an issue, read apache logs and modify the corresponding directive in in php.ini coz i might have missed one or two here. :P

[williamparkar]

I run my first emailing with about 40'000 emails and it went fine.

It tooks a few hours to get emails out but no issues.


Custom Term Papers

[blackradius]

I'm having trouble with the Add To Target List after the import to Targets is complete... it will only do one page (20) at a time... any suggestions