473,394 Members | 2,160 Online
Bytes | Software Development & Data Engineering Community
Post Job

Home Posts Topics Members FAQ

Join Bytes to post your question to a community of 473,394 software developers and data experts.

tricky upload situation request (5GB), is it possible?

We have a dedicated webserver with debian6 (squeeze), apache2, php5 + mysql5. This server is used as a lamp and has 1024mb random access memory. Diskspace is 100GB.

A client needs 5GB filesize uploads for video productions.
Is it possible with PHP/AJAX?
With POST the files get stored first into the RAM and after uploading all data stored to the disk, and that's why we are limited.
There must be a better option for uploading.
I tried with curl and got better results.

I found options like jUpload, where files get chunked.
How would you handle such large uploads?
Sep 13 '11 #1

✓ answered by Dormilich

Does it make a difference using FTP instead of CURL?
that are two different things, FTP is a protocol (like HTTP) and cURL a tool for transferring data (cURL can make use of FTP, FTPS, Gopher, HTTP, HTTPS, SCP, SFTP, TFTP, Telnet, DICT, the file URI scheme, LDAP, LDAPS, IMAP, POP3, SMTP and RTSP)

5 2115
Dormilich
8,658 Expert Mod 8TB
How would you handle such large uploads?
FTP. this is exactly the protocol for that purpose. on the downside, HTML (including JS) is not suited to initiate an FTP transfer. you might want to look into browser extensions, which have access to the browser’s FTP capabilities (eg. Firefox’ FireFTP add-on).
Sep 14 '11 #2
I'm using the upload function inside a joomla 1.7 cms. Does it make a difference using FTP instead of CURL?

thanks for your reply :)

I'd suppose the upload problem results from mod_fcgid

mod_fcgid: stderr: PHP Fatal error: Allowed memory size of 134217728 bytes exhausted (tried to allocate 97477678 bytes) in Unknown on line 0, referer: hxxp:/www.mydomain.com/kontakt-upload.html
Sep 14 '11 #3
Dormilich
8,658 Expert Mod 8TB
Does it make a difference using FTP instead of CURL?
that are two different things, FTP is a protocol (like HTTP) and cURL a tool for transferring data (cURL can make use of FTP, FTPS, Gopher, HTTP, HTTPS, SCP, SFTP, TFTP, Telnet, DICT, the file URI scheme, LDAP, LDAPS, IMAP, POP3, SMTP and RTSP)
Sep 14 '11 #4
from the security point of view, does it make sense to use SFTP upload with an explicit account for one specific uploads folder limited with quota, or will it be possible to capture the login credentials with any debugger?
Sep 14 '11 #5
Dormilich
8,658 Expert Mod 8TB
what I have seen is a time limited FTP account for a specific folder.
Sep 15 '11 #6

Sign in to post your reply or Sign up for a free account.

Similar topics

0
by: Lachlan Hunt | last post by:
Hi everyone, I've just discovered a registry hack to get around the Windows XP SP2 security bug that prevents files being uploaded as text/html, and thus unable to validate local html files using...
25
by: PyPK | last post by:
What possible tricky areas/questions could be asked in Python based Technical Interviews?
1
by: joshbeall | last post by:
Hi All, If I drop a form onto my page that allows file uploads, I know well enough how to handle the file upload in the server side via PHP. However, I have a question: when my browser...
7
by: bearophileHUGS | last post by:
I have tried this, with Psyco it segfaults, and with Python 2.5 (on Win) hangs the interpreter, is it possible to improve the situation? class T(object): def __getattr__(self, x): dir(self)...
4
by: SammyBar | last post by:
Hi all, I wonder is it possible to upload the content of an <imgfield to a server. The content of the <imgwas downloaded from a web site different from the one it should be uploaded. The image...
3
by: shapper | last post by:
Hello, I need to upload a file. Can I only do this with the File Upload control? I also need the following: - Send upload info, upload percentage, continuously to a JavaScript function so...
10
by: Devang | last post by:
Hello, I am using php script to upload file. some times if file size is too big(1GB) it takes too much time to upload. Can someone suggest me the way to increase upload speed. thanks
14
by: BigZero | last post by:
Hello, can nay body tell me how upload works? "well the code that i m using works fine with me i mean that the file uploadin is working but i m unable to find how it internal it works"? when...
4
by: iceanfire | last post by:
On the backend I have a python script that gets two pieces of information from the database: 1. html 2. xml file The javascript is supposed to : 1. inject the html file into a div 2. use the...
0
by: plowgrammer2010 | last post by:
Hi, All I want have a project related to network security. is my given supposition is right. I put my programmed "Device" with my computer, and on each packet receive event by "Device", I wrap a...
0
by: Charles Arthur | last post by:
How do i turn on java script on a villaon, callus and itel keypad mobile phone
0
by: ryjfgjl | last post by:
If we have dozens or hundreds of excel to import into the database, if we use the excel import function provided by database editors such as navicat, it will be extremely tedious and time-consuming...
0
by: emmanuelkatto | last post by:
Hi All, I am Emmanuel katto from Uganda. I want to ask what challenges you've faced while migrating a website to cloud. Please let me know. Thanks! Emmanuel
0
BarryA
by: BarryA | last post by:
What are the essential steps and strategies outlined in the Data Structures and Algorithms (DSA) roadmap for aspiring data scientists? How can individuals effectively utilize this roadmap to progress...
0
by: Hystou | last post by:
There are some requirements for setting up RAID: 1. The motherboard and BIOS support RAID configuration. 2. The motherboard has 2 or more available SATA protocol SSD/HDD slots (including MSATA, M.2...
0
by: Hystou | last post by:
Most computers default to English, but sometimes we require a different language, especially when relocating. Forgot to request a specific language before your computer shipped? No problem! You can...
0
Oralloy
by: Oralloy | last post by:
Hello folks, I am unable to find appropriate documentation on the type promotion of bit-fields when using the generalised comparison operator "<=>". The problem is that using the GNU compilers,...
0
jinu1996
by: jinu1996 | last post by:
In today's digital age, having a compelling online presence is paramount for businesses aiming to thrive in a competitive landscape. At the heart of this digital strategy lies an intricately woven...
0
by: Hystou | last post by:
Overview: Windows 11 and 10 have less user interface control over operating system update behaviour than previous versions of Windows. In Windows 11 and 10, there is no way to turn off the Windows...

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.