Dynamic Programming is a discrete optimization technique. It means, the variables we want to calculate using this method are discrete. As an example, if *x* is one such variable then is acceptable, but ‘*x* is a real number between 0 and 1′ is *NOT* acceptable since there are infinitely many real numbers between 0 and 1. In math terms, we can say that the domain of the variable *x* is a countable set.

Problems that are solved by dynamic programming are recursive nature. Let’s look at the problem that ask us to calculate the sum up to a number, i.e., if is such a function then . The recursive definition (assuming *i* is non negative) is following:

A recursive implementation will be following:

int sum(int i){ if(i==0) return 0; else return i+sum(i-1); }

A iterative implementation will be following:

int sum(int i){ int ret=0; while(i>=0) ret+=i--; return ret; }

As we can see both implementation has the same time complexity. Because, there is no *overlapping sub-problem* here!

Now, let’s look at another problem that ask us to calculate the Fibonacci number. If is such a function then the recursive definition (assuming *i* is non negative) is following:

A recursive implementation will be following:

int fibo(int i){ if(i==0) return 0; else if (i==1) return 1; else return fibo(i-1)+fibo(i-2); }

A iterative implementation will be following:

int fibo(int i){ if(i==0) return 0; else if (i==1) return 1; int []table= new int[i+1]; table[0]=0; table[1]=1; for(int j=2;j<=i;j++) table[j]=table[j-1]+table[j-2]; return table[i]; }

Now, in this case, the iterative implementation is more efficient than the recursive implementation because there are overlapping sub-problems and the recursive solution requires solving the sub-problems more than once. For example, if we want to calculate ‘fibo(5)’, then the recursive implementation will call ‘fibo(4)’ and ‘fibo(3)’, in the next iteration ‘fibo(4)’ will call ‘fibo(3)’ and ‘fibo(2)’. So, ‘fibo(3)’ will be calculated twice from scratch. Whereas, in the iterative implementation the calculated value for a sub-problem is saved and can be used without recalculation. Obviously, the iterative implementation requires more memory to save the results of the sub-problems. We have also just written our first *dynamic programming* solution for the Fibinacci problem.

Dynamic programming is an iterative implementation of a recursive problem with overlapping sub-problems that trades CPU cycles for memory.

### Maximum Value Contiguous Subsequence (MVCS)

Let’s now take a look at a sightly harder problem. The MVCS is defined as follows:

Given a sequence, find the Contiguous Sub-sequence, sum of which is greater than that of any other Contiguous Sub-sequences. Recall, for , is a Sub-sequence but not a Contiguous Sub-sequence. If the input is then MVCS is with the sum 30.

Note that this problem is only interesting if there are both positive and negative numbers in the sequence. If there are only positive numbers then the answer is the input array, and if there are only negative numbers then the answer is an empty set. For a sequence , if denote the sum of optimal sub-sequence ending at position *i* then it can be defined recursively as following:

So, the sum of MVCS will be , and starting from where max occurs we can now backtrack to get MVCS. The implementation is following:

public class MaxValueContiguousSubSeq { private int[] seq; /** * Needed for dynamic programming algorithm. */ private int []table; private int max_i=0; private int max=0; private boolean isCalculated=false; public MaxValueContiguousSubSeq(int[] seq){ this.seq=seq; if(seq!=null && seq.length!=0) table= new int[seq.length]; } /** * Calculates the MVCS * @return sum of the MVCS */ public int calculate(){ isCalculated=true; if(seq==null || seq.length == 0) return max; table[0]=seq[0]; max=Math.max(max, table[0]); for(int i=1;i<seq.length;i++){ table[i]=Math.max(table[i-1]+seq[i], seq[i]); if(max<table[i]){ max=table[i]; max_i=i; } } return max; } public int[] getMaxValueContiguousSubSeq(){ if(seq==null || seq.length == 0) return new int[0]; if(!isCalculated) calculate(); ArrayList<Integer> bt=backTrack(max_i,max); int []ret= new int[bt.size()]; for(int i=0;i<bt.size();i++) ret[i]=bt.get(i); return ret; } private ArrayList<Integer> backTrack(int i,int sum){ if(i<0 || sum<=0) return new ArrayList<Integer>(); else{ ArrayList<Integer> ret=backTrack(i-1,sum-seq[i]); ret.add(seq[i]); return ret; } } }

### Longest Increasing Sub-sequence (LIS)

The LIS is a similar type of problem as the MVCS.

Given a sequence, find the longest Sub-sequence (not necessarily Contiguous) such that each element is strictly greater than its previous in the sub-sequence. If the input is then the LIS is .

For a sequence , if denote the length of longest increasing sub-sequence ending at position *i* then it can be defined recursively as following:

So, the length of LIS will be . Backtracking will be tricky, since does not give enough information to track the previous element. That’s why for backtracking we need to use an extra array to save the path. The implementation is following:

public class LongestIncreasingSubSeq { private int[] seq; /** * Needed for backtracking. Since we are explicitly using this the table variable (look at other dp implementation) can be local in calculate function */ private int []path; private int max_i=0; private int max=0; private boolean isCalculated=false; public LongestIncreasingSubSeq(int[] seq){ this.seq=seq; if(seq!=null && seq.length!=0){ path= new int[seq.length]; } } public int[] getLongestIncreasingSubSeq(){ if(seq==null || seq.length == 0) return new int[0]; if(!isCalculated) calculate(); ArrayList<Integer> bt=backTrack(max_i); int []ret= new int[bt.size()]; for(int i=0;i<bt.size();i++) ret[i]=bt.get(i); return ret; } private ArrayList<Integer> backTrack(int i){ if(i<0) return new ArrayList<Integer>(); else{ ArrayList<Integer> ret=backTrack(path[i]); ret.add(seq[i]); return ret; } } public int calculate(){ isCalculated=true; if(seq==null || seq.length == 0) return 0; int []table= new int[seq.length]; for(int i=0;i<seq.length;i++){ int t_max=0; path[i]=-1; for(int j=0;j<i;j++){ if(seq[j]<seq[i] && table[j]>t_max){ t_max=table[j]; path[i]=j; } } table[i]=t_max+1; if(table[i]>max){ max=table[i]; max_i=i; } } return max; } }

### Unbounded Knapsack Problem

Let’s now take a crack at the popular knapsack problem. The unbounded knapsack problem is defined as follows:

There is a knapsack of capacity

Cand there are there arenitems with weights and values . Assume are strictly positive integers and there are infinitely many of each items, i.e., unbounded. Determine the number of each item to include in the knapsack so that the total weight is less than or equal to the knapsack capacity and the total value is maximized.

Let be the maximum value that can be attained with total weight less than or equal to *w*. Then can be defined recursively as follows:

The implementation of this problem with the recursive formula is now trivial, but backtracking is very tricky. For backtracking, you will need at least *2C+2* more space, which is implemented here. There is a easier backtracking with extra space that can be found elsewhere.

public class UnboundedKnapsack { private int[] weights; private int[] values; private int capacity; /** * Needed for backtracking. */ private int []pathWeight; private int []pathIndex; private int []table; private boolean isCalculated=false; public UnboundedKnapsack(int capacity, int[] weights, int[] values) throws Exception{ if(isNullOrEmpty(weights) || isNullOrEmpty(values) || weights.length!=values.length) throw new Exception("Wrong input."); this.capacity=capacity; this.weights=weights; this.values=values; pathWeight= new int[capacity+1]; pathIndex= new int[capacity+1]; table= new int[capacity+1]; } private boolean isNullOrEmpty(int[] arr){ return arr==null || arr.length==0; } public int[] getItems(){ if(capacity==0) return new int[0]; if(!isCalculated) calculate(); ArrayList<Integer> bt=backTrack(capacity); int []ret= new int[weights.length]; for(int i=0;i<bt.size();i++) ret[bt.get(i)]++; return ret; } private ArrayList<Integer> backTrack(int i){ if(pathWeight[i]<0) return new ArrayList<Integer>(); else{ ArrayList<Integer> ret=backTrack(pathWeight[i]); ret.add(pathIndex[i]); return ret; } } public int calculate(){ isCalculated=true; if(capacity==0) return 0; table[0]=0; pathWeight[0]=-1; for(int i=1;i<=capacity;i++){ int max=-Integer.MAX_VALUE; pathWeight[i]=-1; for(int j=0;j<weights.length;j++){ if(weights[j]<=i && table[i-weights[j]]+values[j]>max){ max=table[i-weights[j]]+values[j]; pathWeight[i]=i-weights[j]; pathIndex[i]=j; } } table[i]=max; } return table[capacity]; } }

### Making Change Problem

The making change problem gives the optimal changes for a given amount of money.

Given

ntypes of coin denominations of values (all integers). Assume , so it is always possible to make change for any amount of moneyC. Give an algorithm which makes change for an amount of moneyCwith as few coins as possible.

As we can see that this problem is almost identical to the unbounded knapsack problem except are all equal, i.e., choosing any of the coins gives us the same benefit and this is a minimization problem. So, if we set then it becomes identical to the unbounded knapsack problem, since makes the maximization problem to a minimization problem. So, the implementation is as follows:

public class MakingChange extends UnboundedKnapsack { public MakingChange(int money, int[] changes) throws Exception { super(money, changes, generateValuesforKnapSack(changes)); } public static int[] generateValuesforKnapSack(int[] weights){ if(weights==null || weights.length==0) return new int[0]; int []ret= new int[weights.length]; for(int i=0;i<weights.length;i++) ret[i]=-1; return ret; } }

### Edit Distance

Given two strings and , we want to transform A into B with a minimum number of operations of the following types: delete a character from A, insert a character into A, or change some character in A into a new character. The minimal number of such operations required to transform A into B is called the edit distance between A and B.

To calculate the edit distance, we will define to be the minimum distance to transform the 1st *i* characters of string A, i.e., to the 1st *j* characters of string B, i.e., , and the cost for insertion, deletion and substitution be respectively . Then the recursive definition is:

With this recursive definition the implementation is following:

public class EditDistance { /** * Costs. */ private static final int c_i=1; private static final int c_d=1; private static final int c_s=1; private String s1; private String s2; /** * Needed for dynamic programming algorithm. */ private int [][]table; private int getMin(int a,int b,int c){ int min=a; if(min>b) min=b; if(min>c) min=c; return min; } private boolean emptyOrNull(String s){ return s==null || s.equals(""); } public EditDistance(String s1,String s2){ this.s1=s1; this.s2=s2; if(!(emptyOrNull(s1) || emptyOrNull(s2) || s1.equals(s2))) //cases we know the edit distance table= new int[s1.length()+1][s2.length()+1]; // a dummy 1st column and dummy 1st row } /** * Calculate the edit distance between s1 and s2 by dynamic programming. * @return edit distance */ public int calculate(){ if(emptyOrNull(s1) && emptyOrNull(s2)) return 0; else if(emptyOrNull(s1)) return s2.length(); else if(emptyOrNull(s2)) return s1.length(); else if(s1.equals(s2)) return 0; for(int i=0;i<s1.length()+1;i++){ table[i][0]=i; } for(int j=0;j<s2.length()+1;j++){ table[0][j]=j; } for(int i=1;i<s1.length()+1;i++){ for(int j=1;j<s2.length()+1;j++){ int dis=s1.charAt(i-1)==s2.charAt(j-1)?0:c_s; table[i][j]=getMin(c_d+table[i-1][j], //deletion c_i+table[i][j-1], //insertion dis+table[i-1][j-1]); //substitution } } return table[s1.length()-1][s2.length()-1]; } }

[Source code: link]

[Unit tests: link]

[Additional practice problems: link]

Tagged: algorithms, code, dynamic-programming, interview, java, latex, optimization, recursion

AmountApproximation : TopCoder SRM 274 (Div-2, Level-3) | Faisal's Blog (TopCoder, ProjectEuler, Codeforces)July 8, 2013 at 12:12 pm[…] the making change problem. For more info about the making change problem checkout my other blog: http://rfaisalblog.wordpress.com/2013/05/19/a-crack-at-dynamic-programming/. But, I could not make out the recursive formula (since there is no exact change!). Ask me any […]