Friday, 23 January 2009

EPrints gets Cloud Storage Support

As some people may know as part of the move towards EPrints 3.2 we have rewritten the way file storage works within EPrints entirely (after the recode we had less lines of source code!). Basically we have implemented an abstracted storage layer called the EPrints Storage Controller that is able to utilize new "storage plug-ins" to store files in different places.

As a starting point myself and Tim Brody have just successfully tested an EPrints install which is storing it's content in Amazon S3/Cloudfront! Details on the power and capabilities of providing these 2 services are outlined briefly here.

Storage Layer features:

  • Write your own plug-ins to marry EPrints with any chosen storage platform.

  • Use multiple plug-ins simultaneously.

  • Impose rules such that all volatile files (thumbnails etc) are stored locally, with the main file being stored in the cloud.

  • Impose rules which state that any document submitted by a Physicist on a Thursday are stored both locally and by two cloud storage providers. All rules are implemented in the existing epc xml scripting language.


What does Cloud Storage mean to your repository?


  • Cloud Storage means less bandwidth usage for provisioning of resources to users.

  • Cloud Storage enables those who don't have money or space to host 100's of Terabytes, to build and control a repository of this size.

  • Services such as Amazons Cloudfront can handle the replication and worldwide distribution of your objects.

  • Your users download documents from their local continental mirror, an advanced feature enabled by the new Storage Controller.

  • Using Amazon services also provides a means by which the users pay for their download bandwidth.


For the Amazon S3 plug-in we used a Storage Controller ruleset which imposed rules meaning only full files were stored in Amazon S3, with all thumbnails and previews remaining local. This reduces the cost of storing and retrieving you files.

Of course the Amazon S3 plug-in is one example of a storage plug-in, you could just as easily write your own.

16 comments:

andy said...
This comment has been removed by the author.
andy said...

I always enjoy learning how other people employ Amazon S3 and CloudFront. I am wondering if you can check out my very own tool CloudBerry Explorer that helps to manage S3 and CloudFront. It is a freeware. http://cloudberrylab.com/

Calvin Brock said...

open and common code base for businesses to build public and private cloud infrastructure – while sharing common approaches to management services and APIs. www.acnc.com

Curt Linking said...

I would like to thnkx for the efforts you've put in writing this website. I'm hoping the same high-grade site post from you in the future too. Actually your creative writing abilities has inspired me to get my own blog going now. Actually blogging is spreading its wings and growing rapidly. Your write up is a great example.
best mattress

Josh Anderson said...

Individual can this last without the credit check process for the individual suffering from bad credit tags like bankruptcy, arrears, late, late payments, foreclosures, bankruptcy, CCJ, IVA, etc.
http://www.3monthpaydayloans6uk.co.uk/

Jake Watson said...

Usually lenders approve people with low credit profile and have no problem, should be supported. On the other side of the coin, you will find no shortage of people running less than perfect loans for bad credit credit history. For these people, online lenders have come forward, and support as needed. So if you have arrears, defaults, CCJ, bankruptcy, late payments and so on, you need to relax. You will be approved online.
It is the style of living is high and the salary that you earn is not enough to assume all costs? If so, then use the bad credit loans no fax individual without cutting any of your expenses on your budget you can easily lifestyle of yours.

Jony walker said...

Moreover, it is unsecured and therefore not have to put any collateral at the front. Therefore he would not go through any risk in relation to your valuable assets.You can avoid any delay in the process of borrowing. Borrower, 6 month loans no guarantor for a pleasant experience, not because they need their credit records must be presented for examination. So you would be able, this outstanding unsecured loans, even if he gets a bad credit rating.
http://uk6monthloans.co.uk/
http://6monthtextloansnoguarantor.co.uk/
http://www.elongtermpaydayloansuk.co.uk/6-month-payday-loans.html

Josh Anderson said...

Finance, operations, financing of up to 100 by this means the repayment period of seven days may get, and to pay a bit high rate of same day loans interest, because it requires no collateral against the loan. By, for example, you can pay the medical bill, electricity bill, grocery bill, water bill, gas bill, phone bill, buy new clothes, business gifts and employ many more aid for 3 month payday loans emergencies. Bad credit factors like defaults, arrears, late payments, arrears, bankruptcy, CCJs, foreclosures, IVA, late payments, missed payments and so on to get taken advantage of loans text without having to go through any credit check formality.
http://www.donglepaydayloans.co.uk/

Josh Anderson said...

This post is really pleasant. I have a great opportunity for you. I am a mediator of 12 month loans it gives you 12 month loans in low interest rate. You are applying this loan in 24 hours. If you are interested please apply here. Every one of us realizes that benefiting an advance obliges bunches of customs that require some serious energy along these lines; individuals attempt to organize cash from different ways when they require it. All things considered, in the event that you are searching for some little money backing and you are having no real way to mastermind it by one means or another, you can seek little fleeting credits that don't request that you experience any long paperwork process or whatever other troublesome strategy to acquire it.
http://www.uk12monthpaydayloans.co/

Bret Smith said...

The form is prohibited without charge, as it is completely free. Everything is done immediately with mouse clicks. The time is stored largely as the need, somewhere is not a part of these loans. The loan is available for 2-3 weeks and can take the 12 month payday loans amount in the range of 500 to 1200 euros. On your next payday the amount back. Ensure that the amount of penalty time otherwise you could pay for free. These loans have a very nice feature, easy payday loans. People who are embarrassed by your bad credit loan can easily without disclosing your credit score. Arrears, late payments, defaults in the past are not taken into account.
http://www.easyloanssinuk.co.uk/

Bret Smith said...

Quick loans are especially for those freeloaders who are struggling with terrible bad credit history such as bankruptcy, ccjs, iva, late payments, arrears, defaults, foreclosures, late payments, missed payments, bankruptcies and even skipping of installments made, more 12 month loans often than not as bad credit creates unfavorable conditions for borrowers to qualify for a loan. Other than that, this is not reason with these funds. See general financial services on aspects other than quick loans credit records at the time, offering these finances for bad creditors. Therefore, all kinds of bad credit scores are allowed to enjoy this loan hassle free manner.
http://www.quickdoorstep12monthloansnoguarantor.co.uk/

Josh Anderson said...

Does the shortage of 12 month payday loans funds for all time because of their limited income? Need quick cash to cover cost overruns? One thing is for you, which apply for the loan. Do not waste your valuable time. Weekend 12 month loans online are the way through which you need for financial security without giving applies. You can take help of 12 month loans immediately and if you ask their situations schedule at all times, emergency weekends or holidays. 12 month loans weekend online 24 hours and 7 days a week, financial services, go with all mandatory and urgent 12 month loans no credit check financial needs to help meet anytime. These loans help you get rid of all the problems created sudden arrival of travel costs, accident costs, medical expenses, car repair, grocery bills, grocery bills, shopping and the list goes on.
http://www.uk12monthpaydayloans.co/

Jake Watson said...

No funds to a savings or emergency. A cash advance or unsecured loans bad credit can provide the personal loans with bad credit necessary funds available to cover an emergency or to pay an unexpected debt. The funds of a cash advance can be used to cover unexpected high bills, or medical emergency repairs when a vehicle will fail. Michigan residents have the same financial problems as a citizen of any other state in the country. A unsecured loans bad credit can help you when working in difficult moments. Continue your financial obligations on track Ensure invoices are paid on credit ratings Time and stories to help clean and timely payment. You can create a budget for you to spend your money wisely. To maintain an effective budget expenditure in line with the income of a person and even allow the establishment of a small savings loans with no credit check account. With all our records careful planning and dedicated, accidents and emergencies can still happen what our finances to take a quick dip. Request a cash advance or unsecured loans bad credit, costs of most households do not cover it.
http://www.yespaydayloanss.co.uk/fast-personal-loans-with-bad-credit.html
http://www.yespaydayloanss.co.uk/unsecured-personal-loans-bad-credit.html
http://www.yespaydayloanss.co.uk/loans-with-no-credit-checks-or-fees.html

Bret Smith said...

This time, relative to wage fragment are connected constantly pull painful for those close by 12 month loans directions away Strew fixed costs of its occurrence is relevant, their lives plain spoken Dick assumed above ads. Soon you develop difficult rising level of the patient in his caliber brutal admirer supply falls track, you can immediately behind the accumulation of rotation incite line offers shelter are 24X7 innocent 12 month payday loans change in an eon discretion periphery of fine concur specified. 12 month loans are months to join you agree on earth the sun by an alternate as snake rake yon basis 12 month loans no credit check insensitive lob in the fierce rebound. In order to respect different views in terms of a joker fastest stage affair de coerce argue in the air, finds engagement ring for lenders online trading.
http://ontextloans.co.uk/
http://doorstep12monthloansuk.co.uk/
http://www.atozloansinuk.co.uk/
http://www.uk12monthpaydayloans.co/

Bret Smith said...

Recently, HTC has become one of the leading brands in the telecommunications industry. Company has already mobile phones deals launched its products in all parts of the world to life. Within a very short duration, HTC has had great success with its elegant and best quality mobile phones. In terms of performance, nothing can beat these devices. Company mobile phones for sale manufactures durable and reliable mobile phone. This is the only reason that people expect from HTC phones so eagerly. Recently, consumers had the opportunity to see HTC One m8 deals in the market. After the success of the company's product HTC one M8 deals decided to launch mobile phone deals from your phone. Actually make these offers can consumers for widgets technology at affordable prices.

http://www.htconem8.co.uk/

Apoorva Kumar said...

The economy of India is in better position now. Says the government officials and bank employees. Thanks to the policies and budgets by the new prime minister of India.

Regards,
Apoorva
Home Loan in Lucknow